Combination prism array for focusing light

ABSTRACT

A beam deflection device includes two arrays of prisms. The prisms in the first array of prisms have an apex angle below a critical angle such that light passes through the prism and is deflected at an angle below a specified angle. The prisms in the second array of prisms have an apex angle above the critical angle such that light that enters the prism will reflect off the apex surface to an exit surface, resulting in the light being deflected at an angle above the specified angle. In some embodiments, the prisms in the first array and the second array work in conjunction to direct light from multiple locations to a single focal point.

RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 15/270,803, filed Sep. 20, 2016, which claims the priority toU.S. Provisional Patent Application Ser. No. 62/246,117, filed Oct. 25,2015, both of which are incorporated by reference herein in theirentireties. This application is related to U.S. patent application Ser.No. 15/065,772, filed Mar. 9, 2016; U.S. patent application Ser. No.15/065,778, filed Mar. 9, 2016; and U.S. patent application Ser. No.15/270,803, filed Sep. 20, 2016, all of which are incorporated byreference herein in their entireties.

TECHNICAL FIELD

This relates generally to display devices, and more specifically tohead-mounted display devices.

BACKGROUND

Head-mounted display devices (also called herein head-mounted displays)are gaining popularity as means for providing visual information touser. A large field of view is required to provide an immersive virtualreality and/or augmented reality experience. This allows users to lookin different directions (by moving his or her eye) and still seeprojected visual information.

However, pixels of a display screen are configured to project light in adirection perpendicular to the screen. The pixels, when viewed at anangle (e.g., especially at an angle outside a viewing angle of thepixels), appear dim. Thus, pixels located in a center region of thedisplay screen appear brighter than pixels located in a peripheralregion of the display screen, which reduces viewing experience of users.

SUMMARY

Accordingly, there is a need for an optical element that can direct (orfocus) light, including light from the central region and the peripheralregion of the display screen, toward a single location, such as at auser's eye, thereby enhancing the user's virtual-reality and/oraugmented reality experience. There is a further need to direct thelight in a portable system that can be mounted on a user's head.

The above deficiencies and other problems associated with conventionalhead-mounted displays are reduced or eliminated by the disclosed beamdeflection devices. In some embodiments, the device is a head-mounteddisplay device. In some embodiments, the device is portable.

In accordance with some embodiments, a beam deflector device includes asingle integrated substrate that has a planar entrance surface and anon-planar exit surface. The single integrated substrate includes, onthe non-planar exit surface, a first array of light-steering components.A respective component of the first array of light-steering componentsis located at a respective distance less than a predefined distance froma reference point. The respective component of the first array oflight-steering components includes an optical prism having an apex anglethat is less than a critical angle. The first array of light-steeringcomponents includes a first prism having a first apex angle and a secondprism having a second apex angle that is distinct from the first apexangle. The single integrated substrate also includes, on the non-planarexit surface, a second array of light-steering components. A respectivecomponent of the second array of light-steering components is located ata respective distance greater than the predefined distance from thereference point. The respective component of the second array oflight-steering components includes an optical prism having an apex anglethat is greater than the critical angle. In some embodiments, the secondarray of light-steering components includes a third prism having a thirdapex angle that is distinct from the first apex angle and the secondapex angle and a fourth prism having a fourth apex angle that isdistinct from the first apex angle, the second apex angle, and the thirdapex angle.

In accordance with some embodiments, a display device includes atwo-dimensional array of pixels. Each pixel is configured to outputlight so that the two-dimensional array of pixels outputs a respectivepattern of light. The display device also includes any beam deflectordevice described herein, which is configured to transmit the respectivepattern of light from the two-dimensional array of pixels.

In accordance with some embodiments, a method (e.g., performed at adisplay device) includes outputting a respective pattern of light from atwo-dimensional array of pixels; and transmitting the respective patternof light through any beam deflector device described herein.

Thus, the disclosed embodiments provide optical elements that can directlight from peripheral regions of display devices toward at a user's eyewith increased efficiency and effectiveness, which, in turn, increasesuser satisfaction with such devices.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the various described embodiments,reference should be made to the Description of Embodiments below, inconjunction with the following drawings in which like reference numeralsrefer to corresponding parts throughout the figures.

FIG. 1 is a perspective view of a display device in accordance with someembodiments.

FIG. 2 is a block diagram of system including a display device inaccordance with some embodiments.

FIG. 3A is an isometric view of an adjustable electronic display elementof a display device in accordance with some embodiments.

FIG. 3B is a partial cross-sectional view of the adjustable electronicdevice in accordance with some embodiments.

FIG. 3C is a perspective view of a tile in accordance with someembodiments.

FIG. 3D is a perspective view of a portion of the adjustable electronicdisplay element in accordance with some embodiments.

FIGS. 3E-3G are schematic diagrams illustrating an exemplary operationof tiles in accordance with some embodiments.

FIGS. 3H-3I are schematic diagrams illustrating exemplary operations ofactivating a subset of tiles in accordance with some embodiments.

FIGS. 4A and 4B illustrate prophetic examples of correcting brightnessvariations in accordance with some embodiments.

FIG. 5 is a flow diagram illustrating a method of activating a subset ofa two-dimensional array of tiles of a display device in accordance withsome embodiments.

FIG. 6A is a schematic diagram illustrating a lens assembly inaccordance with some embodiments.

FIG. 6B is a zoomed-in view of the lens assembly shown in FIG. 6A.

FIG. 6C is a perspective view of a two-dimensional array of tiles inaccordance with some embodiments.

FIG. 6D is a schematic diagram illustrating lens assemblies inaccordance with some embodiments.

FIG. 6E is a schematic diagram illustrating lens assemblies inaccordance with some embodiments.

FIG. 6F is a schematic diagram illustrating lens assemblies inaccordance with some embodiments.

FIG. 6G is a schematic diagram illustrating lens assemblies inaccordance with some embodiments.

FIG. 6H is a schematic diagram illustrating lens assemblies inaccordance with some embodiments.

FIG. 6I is a schematic diagram illustrating a display device with lensassemblies in accordance with some embodiments.

FIG. 6J is a schematic diagram illustrating an elevation view of anarray of lens assemblies in accordance with some embodiments.

FIG. 7A is a cross-sectional view of a beam deflector device inaccordance with some embodiments.

FIG. 7B is an example ray diagram that depicts rays of light passingthrough the beam deflector device shown in FIG. 7A.

FIG. 7C is a cross-sectional view of a beam deflector device inaccordance with some embodiments.

FIG. 7D is a perspective view of a beam deflector device in accordancewith some embodiments.

FIG. 7E is a front elevational view of the beam deflector device shownin FIG. 7D.

FIG. 7F is a front elevational view of a beam deflector device inaccordance with some embodiments.

FIG. 7G is a schematic diagram of a beam deflector device in accordancewith some embodiments.

FIG. 7H is a schematic diagram of a display device with a beam deflectordevice in accordance with some embodiments.

These figures are not drawn to scale unless indicated otherwise.

DETAILED DESCRIPTION

Conventional head-mounted displays are larger and heavier than typicaleyeglasses, because conventional head-mounted displays often include acomplex set of optics that can be bulky and heavy. Although a largefield of view is required to provide an immersive virtual reality and/oraugmented reality experience, a conventional display screen isconfigured to project light in a direction perpendicular to the displayscreen. As a result, light emitted by peripheral regions of the displayscreen is not well directed to an eye of a user. Thus, there is a needfor an optical element that can direct (or focus) light, including lightfrom the central region and the peripheral region of a large displayscreen, toward an eye of the user. However, such optical element can belarge and heavy, which further increases the size and weight ofhead-mounted displays. It is not easy for users to get used to wearingsuch large and heavy head-mounted displays.

The disclosed embodiments, by utilizing a first array of prisms toperform small deflections of light from a central region of the displayand a second array of prisms to perform larger deflections of light froma peripheral region of the display, allow direction of light from alarge display screen, such light from each light source in the displayscreen (e.g., pixels) will be directed toward an eye of a user. Thisfacilitates light emitted from the display screen to be deliveredefficiently and effectively to an eye of the user, regardless of whetherthe user is looking straight ahead or has moved his eyeball to look up,down, left, or right, thereby providing an improved user experience withthe display devices.

Because a total internal reflection (TIR) of a prism of the second arrayof prisms is used to provide a large deflection (e.g., a deflection of45 degrees or above), optical artifacts associated with diffractive orholographic optics (e.g., diffraction, hazing, etc.) are reduced.

Reference will now be made to embodiments, examples of which areillustrated in the accompanying drawings. In the following description,numerous specific details are set forth in order to provide anunderstanding of the various described embodiments. However, it will beapparent to one of ordinary skill in the art that the various describedembodiments may be practiced without these specific details. In otherinstances, well-known methods, procedures, components, circuits, andnetworks have not been described in detail so as not to unnecessarilyobscure aspects of the embodiments.

It will also be understood that, although the terms first, second, etc.are, in some instances, used herein to describe various elements, theseelements should not be limited by these terms. These terms are used onlyto distinguish one element from another. For example, a first prismcould be termed a second prism, and, similarly, a second prism could betermed a first prism, without departing from the scope of the variousdescribed embodiments. The first prism and the second prism are bothprisms, but they are not the same prism.

The terminology used in the description of the various describedembodiments herein is for the purpose of describing particularembodiments only and is not intended to be limiting. As used in thedescription of the various described embodiments and the appendedclaims, the singular forms “a,” “an,” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “includes,” “including,” “comprises,” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof. The term “exemplary” is used herein in the senseof “serving as an example, instance, or illustration” and not in thesense of “representing the best of its kind.”

FIG. 1 illustrates display device 100 in accordance with someembodiments. In some embodiments, display device 100 is configured to beworn on a head of a user (e.g., by having the form of spectacles oreyeglasses, as shown in FIG. 1) or to be included as part of a helmetthat is to be worn by the user. When display device 100 is configured tobe worn on a head of a user or to be included as part of a helmet,display device 100 is called a head-mounted display. Alternatively,display device 100 is configured for placement in proximity of an eye oreyes of the user at a fixed location, without being head-mounted (e.g.,display device 100 is mounted in a vehicle, such as a car or anairplane, for placement in front of an eye or eyes of the user).

In some embodiments, display device 100 includes one or more componentsdescribed below with respect to FIG. 2. In some embodiments, displaydevice 100 includes additional components not shown in FIG. 2.

FIG. 2 is a block diagram of system 200 in accordance with someembodiments. The system 200 shown in FIG. 2 includes display device 205(which corresponds to display device 100 shown in FIG. 1), imagingdevice 235, and input interface 240 that are each coupled to console210. While FIG. 2 shows an example of system 200 including one displaydevice 205, imaging device 235, and input interface 240, in otherembodiments, any number of these components may be included in system200. For example, there may be multiple display devices 205 each havingassociated input interface 240 and being monitored by one or moreimaging devices 235, with each display device 205, input interface 240,and imaging devices 235 communicating with console 210. In alternativeconfigurations, different and/or additional components may be includedin system 200. For example, in some embodiments, console 210 isconnected via a network (e.g., the Internet) to system 200 or isself-contained as part of display device 205 (e.g., physically locatedinside display device 205). In some embodiments, display device 205 isused to create mixed reality by adding in a view of the realsurroundings. Thus, display device 205 and system 200 described here candeliver virtual reality, mixed reality, and augmented reality.

In some embodiments, as shown in FIG. 1, display device 205 is ahead-mounted display that presents media to a user. Examples of mediapresented by display device 205 include one or more images, video,audio, or some combination thereof. In some embodiments, audio ispresented via an external device (e.g., speakers and/or headphones) thatreceives audio information from display device 205, console 210, orboth, and presents audio data based on the audio information. In someembodiments, display device 205 immerses a user in a virtualenvironment.

In some embodiments, display device 205 also acts as an augmentedreality (AR) headset. In these embodiments, display device 205 augmentsviews of a physical, real-world environment with computer-generatedelements (e.g., images, video, sound, etc.). Moreover, in someembodiments, display device 205 is able to cycle between different typesof operation. Thus, display device 205 operate as a virtual reality (VR)device, an AR device, as glasses or some combination thereof (e.g.,glasses with no optical correction, glasses optically corrected for theuser, sunglasses, or some combination thereof) based on instructionsfrom application engine 255.

Display device 205 includes electronic display 215, one or moreprocessors 216, eye tracking module 217, adjustment module 218, one ormore locators 220, one or more position sensors 225, one or moreposition cameras 222, memory 228, inertial measurement unit (IMU) 230,or a subset or superset thereof (e.g., display device 205 withelectronic display 215, one or more processors 216, and memory 228,without any other listed components). Some embodiments of display device205 have different modules than those described here. Similarly, thefunctions can be distributed among the modules in a different mannerthan is described here.

One or more processors 216 (e.g., processing units or cores) executeinstructions stored in memory 228. Memory 228 includes high-speed randomaccess memory, such as DRAM, SRAM, DDR RAM or other random access solidstate memory devices; and may include non-volatile memory, such as oneor more magnetic disk storage devices, optical disk storage devices,flash memory devices, or other non-volatile solid state storage devices.Memory 228, or alternately the non-volatile memory device(s) withinmemory 228, includes a non-transitory computer readable storage medium.In some embodiments, memory 228 or the computer readable storage mediumof memory 228 stores the following programs, modules and datastructures, or a subset or superset thereof:

-   -   instructions for activating at least a subset of a        two-dimensional array of tiles for outputting, from at least the        subset of the two-dimensional array of tiles, a collective        pattern of light that is directed to a pupil of an eye of a        user;    -   instructions for, prior to activating at least the subset of the        two-dimensional array of tiles, selecting the subset of the        two-dimensional array of tiles for activation;    -   instructions for directing the light from each pixel that        outputs light to a pupil of an eye of a user; and    -   instructions for activating at least the subset of the        two-dimensional array of tiles include instructions for        activating less than all of the tiles of the two-dimensional        array of tiles.

Electronic display 215 displays images to the user in accordance withdata received from console 210 and/or processor(s) 216. In variousembodiments, electronic display 215 may comprise a single adjustableelectronic display element or multiple adjustable electronic displayselements (e.g., a display for each eye of a user). As discussed indetail below with regard to FIGS. 3A-3G, an adjustable electronicdisplay element is comprised of a display element, one or moreintegrated microlens arrays, or some combination thereof. The adjustableelectronic display element may be flat, cylindrically curved, or havesome other shape.

In some embodiments, the display element includes an array of lightemission devices and a corresponding array of emission intensity array.An emission intensity array is an array of electro-optic pixels,opto-electronic pixels, some other array of devices that dynamicallyadjust the amount of light transmitted by each device, or somecombination thereof. These pixels are placed behind an array ofmicrolenses, and are arranged in groups. Each group of pixels outputslight that is directed by the microlens in front of it to a differentplace on the retina where light from these groups of pixels are thenseamlessly “tiled” to appear as one continuous image. In someembodiments, computer graphics, computational imaging and othertechniques are used to pre-distort the image information (e.g.,correcting for the brightness variations) sent to the pixel groups sothat through the distortions of the system from optics, electronics,electro-optics, and mechanicals, a smooth seamless image appears on theback of the retina, as described below with respect to FIGS. 4A and 4B.In some embodiments, the emission intensity array is an array of liquidcrystal based pixels in an LCD (a Liquid Crystal Display). Examples ofthe light emission devices include: an organic light emitting diode, anactive-matrix organic light-emitting diode, a light emitting diode, sometype of device capable of being placed in a flexible display, or somecombination thereof. The light emission devices include devices that arecapable of generating visible light (e.g., red, green, blue, etc.) usedfor image generation. The emission intensity array is configured toselectively attenuate individual light emission devices, groups of lightemission devices, or some combination thereof. Alternatively, when thelight emission devices are configured to selectively attenuateindividual emission devices and/or groups of light emission devices, thedisplay element includes an array of such light emission devices withouta separate emission intensity array.

The microlens arrays are arrays of lenslets that direct light from thearrays of light emission devices (optionally through the emissionintensity arrays) to locations within each eyebox and ultimately to theback of the user's retina(s). An eyebox is a region that is occupied byan eye of a user located proximity to display device 205 (e.g., a userwearing display device 205 for viewing images from display device 205).In some cases, the eyebox is represented as a 10 mm×10 mm square (see,e.g., FIG. 3D). In some embodiments, a lenslet is a conventional passivelens (e.g., glass lens, plastic lens, etc.) or an active lens (e.g.,liquid crystal lens, liquid lens, etc.). In some embodiments, displaydevice 205 dynamically adjusts the curvature and/or refractive abilityof active lenslets to direct light to specific locations within eacheyebox (e.g., location of pupil). In some embodiments, one or more ofthe microlens arrays include one or more coatings, such asanti-reflective coatings.

In some embodiments, the display element includes an infrared (IR)detector array that detects IR light that is retro-reflected from theretinas of a viewing user, from the surface of the corneas, lenses ofthe eyes, or some combination thereof. The IR detector array includes anIR sensor or a plurality of IR sensors that each correspond to adifferent position of a pupil of the viewing user's eye. In alternateembodiments, other eye tracking systems may also be employed.

Eye tracking module 217 determines locations of each pupil of a user'seyes. In some embodiments, eye tracking module 217 instructs electronicdisplay 215 to illuminate the eyebox with IR light (e.g., via IRemission devices in the display element).

A portion of the emitted IR light will pass through the viewing user'spupil and be retro-reflected from the retina toward the IR detectorarray, which is used for determining the location of the pupil.Alternatively, the reflection off of the surfaces of the eye is used toalso determine location of the pupil. The IR detector array scans forretro-reflection and identifies which IR emission devices are activewhen retro-reflection is detected. Eye tracking module 217 may use atracking lookup table and the identified IR emission devices todetermine the pupil locations for each eye. The tracking lookup tablemaps received signals on the IR detector array to locations(corresponding to pupil locations) in each eyebox. In some embodiments,the tracking lookup table is generated via a calibration procedure(e.g., user looks at various known reference points in an image—and eyetracking module 217 maps the locations of the user's pupil while lookingat the reference points to corresponding signals received on the IRtracking array). As mentioned above, in some embodiments, system 200 mayuse other eye tracking systems than the embedded IR one described above.

Adjustment module 218 generates an image frame based on the determinedlocations of the pupils. This sends a discrete image to the display thatwill tile subimages together thus a coherent stitched image will appearon the back of the retina. A small portion of each image is projectedthrough each lenslet in the lenslet array. Adjustment module 218 adjustsan output (i.e. the generated image frame) of electronic display 215based on the detected locations of the pupils. Adjustment module 218instructs portions of electronic display 215 to pass image light to thedetermined locations of the pupils. In some embodiments, adjustmentmodule 218 also instructs the electronic display to not pass image lightto positions other than the determined locations of the pupils.Adjustment module 218 may, for example, block and/or stop light emissiondevices whose image light falls outside of the determined pupillocations, allow other light emission devices to emit image light thatfalls within the determined pupil locations, translate and/or rotate oneor more display elements, dynamically adjust curvature and/or refractivepower of one or more active lenslets in the microlens arrays, or somecombination thereof.

In some embodiments, adjustment module 218 is configured to instruct thedisplay elements to not use every pixel (e.g., one or more lightemission devices), such that black spaces aperture the diverging lightto abut the image together from the retinal perspective. In addition, insome embodiments, gaps are created between the pixel groups or “tiles”to match divergence of the light source array and the magnification ofthe group of pixels as it transverses through the optical system andfully fills the lenslet. In some embodiments, adjustment module 218determines, for a given position of an eye, which pixels are turned onand which pixels are turned off—with the resulting image beingseamlessly tiled on the eye's retina.

Optional locators 220 are objects located in specific positions ondisplay device 205 relative to one another and relative to a specificreference point on display device 205. A locator 220 may be a lightemitting diode (LED), a corner cube reflector, a reflective marker, atype of light source that contrasts with an environment in which displaydevice 205 operates, or some combination thereof. In embodiments wherelocators 220 are active (i.e., an LED or other type of light emittingdevice), locators 220 may emit light in the visible band (e.g., about400 nm to 750 nm), in the infrared band (e.g., about 750 nm to 1 mm), inthe ultraviolet band (about 100 nm to 400 nm), some other portion of theelectromagnetic spectrum, or some combination thereof.

In some embodiments, locators 220 are located beneath an outer surfaceof display device 205, which is transparent to the wavelengths of lightemitted or reflected by locators 220 or is thin enough to notsubstantially attenuate the wavelengths of light emitted or reflected bylocators 220. Additionally, in some embodiments, the outer surface orother portions of display device 205 are opaque in the visible band ofwavelengths of light. Thus, locators 220 may emit light in the IR bandunder an outer surface that is transparent in the IR band but opaque inthe visible band.

IMU 230 is an electronic device that generates calibration data based onmeasurement signals received from one or more position sensors 225.Position sensor 225 generates one or more measurement signals inresponse to motion of display device 205. Examples of position sensors225 include: one or more accelerometers, one or more gyroscopes, one ormore magnetometers, another suitable type of sensor that detects motion,a type of sensor used for error correction of IMU 230, or somecombination thereof. Position sensors 225 may be located external to IMU230, internal to IMU 230, or some combination thereof.

Based on the one or more measurement signals from one or more positionsensors 225, IMU 230 generates first calibration data indicating anestimated position of display device 205 relative to an initial positionof display device 205. For example, position sensors 225 includemultiple accelerometers to measure translational motion (forward/back,up/down, left/right) and multiple gyroscopes to measure rotationalmotion (e.g., pitch, yaw, roll). In some embodiments, IMU 230 rapidlysamples the measurement signals and calculates the estimated position ofdisplay device 205 from the sampled data. For example, IMU 230integrates the measurement signals received from the accelerometers overtime to estimate a velocity vector and integrates the velocity vectorover time to determine an estimated position of a reference point ondisplay device 205. Alternatively, IMU 230 provides the sampledmeasurement signals to console 210, which determines the firstcalibration data. The reference point is a point that may be used todescribe the position of display device 205. While the reference pointmay generally be defined as a point in space; however, in practice thereference point is defined as a point within display device 205 (e.g., acenter of IMU 230).

In some embodiments, IMU 230 receives one or more calibration parametersfrom console 210. As further discussed below, the one or morecalibration parameters are used to maintain tracking of display device205. Based on a received calibration parameter, IMU 230 may adjust oneor more IMU parameters (e.g., sample rate). In some embodiments, certaincalibration parameters cause IMU 230 to update an initial position ofthe reference point so it corresponds to a next calibrated position ofthe reference point. Updating the initial position of the referencepoint as the next calibrated position of the reference point helpsreduce accumulated error associated with the determined estimatedposition. The accumulated error, also referred to as drift error, causesthe estimated position of the reference point to “drift” away from theactual position of the reference point over time.

Imaging device 235 generates calibration data in accordance withcalibration parameters received from console 210. Calibration dataincludes one or more images showing observed positions of locators 220that are detectable by imaging device 235. In some embodiments, imagingdevice 235 includes one or more still cameras, one or more videocameras, any other device capable of capturing images including one ormore locators 220, or some combination thereof. Additionally, imagingdevice 235 may include one or more filters (e.g., used to increasesignal to noise ratio). Imaging device 235 is configured to optionallydetect light emitted or reflected from locators 220 in a field of viewof imaging device 235. In embodiments where locators 220 include passiveelements (e.g., a retroreflector), imaging device 235 may include alight source that illuminates some or all of locators 220, whichretro-reflect the light towards the light source in imaging device 235.Second calibration data is communicated from imaging device 235 toconsole 210, and imaging device 235 receives one or more calibrationparameters from console 210 to adjust one or more imaging parameters(e.g., focal length, focus, frame rate, ISO, sensor temperature, shutterspeed, aperture, etc.).

Input interface 240 is a device that allows a user to send actionrequests to console 210. An action request is a request to perform aparticular action. For example, an action request may be to start or endan application or to perform a particular action within the application.Input interface 240 may include one or more input devices. Example inputdevices include: a keyboard, a mouse, a game controller, data from brainsignals, data from other parts of the human body, or any other suitabledevice for receiving action requests and communicating the receivedaction requests to console 210. An action request received by inputinterface 240 is communicated to console 210, which performs an actioncorresponding to the action request. In some embodiments, inputinterface 240 may provide haptic feedback to the user in accordance withinstructions received from console 210. For example, haptic feedback isprovided when an action request is received, or console 210 communicatesinstructions to input interface 240 causing input interface 240 togenerate haptic feedback when console 210 performs an action.

Console 210 provides media to display device 205 for presentation to theuser in accordance with information received from one or more of:imaging device 235, display device 205, and input interface 240. In theexample shown in FIG. 1, console 210 includes application store 245,tracking module 250, and application engine 255. Some embodiments ofconsole 210 have different modules than those described in conjunctionwith FIG. 2. Similarly, the functions further described below may bedistributed among components of console 210 in a different manner thanis described here.

When application store 245 is included in console 210, application store245 stores one or more applications for execution by console 210. Anapplication is a group of instructions, that when executed by aprocessor, is used for generating content for presentation to the user.Content generated by the processor based on an application may be inresponse to inputs received from the user via movement of display device205 or input interface 240. Examples of applications include: gamingapplications, conferencing applications, video playback application, orother suitable applications.

When tracking module 250 is included in console 210, tracking module 250calibrates system 200 using one or more calibration parameters and mayadjust one or more calibration parameters to reduce error indetermination of the position of display device 205. For example,tracking module 250 adjusts the focus of imaging device 235 to obtain amore accurate position for observed locators on display device 205.Moreover, calibration performed by tracking module 250 also accounts forinformation received from IMU 230. Additionally, if tracking of displaydevice 205 is lost (e.g., imaging device 235 loses line of sight of atleast a threshold number of locators 220), tracking module 250re-calibrates some or all of system 200.

In some embodiments, tracking module 250 tracks movements of displaydevice 205 using second calibration data from imaging device 235. Forexample, tracking module 250 determines positions of a reference pointof display device 205 using observed locators from the secondcalibration data and a model of display device 205. In some embodiments,tracking module 250 also determines positions of a reference point ofdisplay device 205 using position information from the first calibrationdata. Additionally, in some embodiments, tracking module 250 may useportions of the first calibration data, the second calibration data, orsome combination thereof, to predict a future location of display device205. Tracking module 250 provides the estimated or predicted futureposition of display device 205 to application engine 255.

Application engine 255 executes applications within system 200 andreceives position information, acceleration information, velocityinformation, predicted future positions, or some combination thereof ofdisplay device 205 from tracking module 250. Based on the receivedinformation, application engine 255 determines content to provide todisplay device 205 for presentation to the user. For example, if thereceived information indicates that the user has looked to the left,application engine 255 generates content for display device 205 thatmirrors the user's movement in a virtual environment. Additionally,application engine 255 performs an action within an applicationexecuting on console 210 in response to an action request received frominput interface 240 and provides feedback to the user that the actionwas performed. The provided feedback may be visual or audible feedbackvia display device 205 or haptic feedback via input interface 240.

FIG. 3A is an isometric view of an adjustable electronic display element300 of display device 205, in accordance with some embodiments. In someother embodiments, adjustable electronic display element 300 is part ofsome other electronic display (e.g., digital microscope, etc.). In someembodiments, adjustable electronic display element 300 includes lightemission device array 305, emission intensity array 310, microlens array315, and IR detector array 320. In some other embodiments, adjustableelectronic display element 300 includes a subset or superset of lightemission device array 305, emission intensity array 310, microlens array315, and IR detector array 320 (e.g., adjustable electronic displayelement 300 includes an adjustable light emission device array thatincludes individually adjustable pixels and microlens array 315, withouta separate emission intensity array).

Light emission device array 305 emits image light and optional IR lighttoward the viewing user. Light emission device array 305 may be, e.g.,an array of LEDs, an array of microLEDs, an array of OLEDs, or somecombination thereof. Light emission device array 305 includes lightemission devices that emit light in the visible light (and optionallyincludes devices that emit light in the IR).

Emission intensity array 310 is configured to selectively attenuatelight emitted from light emission array 305. In some embodiments,emission intensity array 310 is composed of a plurality of liquidcrystal cells or pixels, groups of light emission devices, or somecombination thereof. Each of the liquid crystal cells is, or in someembodiments, groups of liquid crystal cells are, addressable to havespecific levels of attenuation. For example, at a given time, some ofthe liquid crystal cells may be set to no attenuation, while otherliquid crystal cells may be set to maximum attenuation. In this manneremission intensity array 310 is able to control what portion of theimage light emitted from light emission device array 305 is passed tothe microlens array 315. In some embodiments, display device 205 usesemission intensity array 310 to facilitate providing image light to alocation of pupil 330 of eye 325 of a user, and minimize the amount ofimage light provided to other areas in the eyebox.

Microlens array 315 receives the modified image light (e.g., attenuatedlight) from emission intensity array 310, and directs the modified imagelight to a location of pupil 330. Microlens array 315 includes aplurality of lenslets. In some embodiments, microlens array 315 includesone or more diffractive optics. A lenslet may be a conventional passivelens (e.g., glass lens, plastic lens, etc.) or an active lens. An activelens is a lens whose lens curvature and/or refractive ability may bedynamically controlled (e.g., via a change in applied voltage). Anactive lens may be a liquid crystal lens, a liquid lens (e.g., usingelectro-wetting), or some other lens whose curvature and/or refractiveability may be dynamically controlled, or some combination thereof.Accordingly, in some embodiments, system 200 may dynamically adjust thecurvature and/or refractive ability of active lenslets to direct lightreceived from emission intensity array 310 to pupil 330.

Optional IR detector array 320 detects IR light that has beenretro-reflected from the retina of eye 325, a cornea of eye 325, acrystalline lens of eye 325, or some combination thereof. IR detectorarray 320 includes either a single IR sensor or a plurality of IRsensitive detectors (e.g., photodiodes). While IR detector array 320 inFIG. 3A is shown separate from light emission device array 305, in someembodiments, IR detector array 320 may be integrated into light emissiondevice array 305.

In some embodiments, light emission device array 305 and emissionintensity array 310 make up a display element. Alternatively, thedisplay element includes light emission device array 305 (e.g., whenlight emission device array 305 includes individually adjustable pixels)without emission intensity array 310. In some embodiments, the displayelement additionally includes IR array 320. In some embodiments, inresponse to a determined location of pupil 335, the display elementadjusts the emitted image light such that the light output by thedisplay element is refracted by microlens array 315 toward the locationof pupil 335, and not toward other locations in the eyebox.

FIG. 3B is a partial cross-sectional view of adjustable electronicdevice 340 in accordance with some embodiments.

Adjustable electronic device 340 includes a two-dimensional array oftiles 360 (e.g., 10-by-10 array of tiles 360, as shown in FIG. 3B). Insome cases, each tile has a shape of a 1-mm-by-1-mm square, althoughtiles of different sizes and/or shapes can be used. In some embodiments,the two-dimensional array of tiles 360 is arranged on a flat surface. Insome other embodiments, the two-dimensional array of tiles 360 isarranged on a curved surface or a surface of any other shape. AlthoughFIG. 3B shows a square array of tiles 360, in some other embodiments,the two-dimensional array of tiles 360 may have a rectangular shape, orany other shape (e.g., a rasterized circle or a rasterized ellipse). Inaddition, a different number of tiles 360 may be used depending on thedesired performance of the display device (e.g., a field of view).

As explained above, tile 360 includes a lens. In some embodiments,lenses for the two-dimensional array of tiles are provided in a form ofa microlens array (e.g., microlens array 315 in FIG. 3A). In FIG. 3B, aportion of the microlens array is not shown (e.g., an upper-left portionof the microlens array indicated by the line XX′) to illustrate groupsof pixels located behind it.

FIG. 3B also illustrates that each tile 360 includes a two-dimensionalarray 344 of pixels 346 (e.g., 10-by-10 array of pixels). In some otherembodiments, the tiles 360 may include different numbers of pixels(e.g., 40-by-40 pixels).

In some embodiments, the two-dimensional array 344 of pixels 346 doesnot encompass the entire surface of tile 360, as shown in FIG. 3B. Insuch embodiments, a portion of tile 360 (e.g., an area along a peripheryof tile 360) not covered by the pixels 346 includes electronic circuitsfor operating pixels 346 on tile 360 (e.g., adjusting individual pixels346 and/or subpixels to turn on or off).

In FIG. 3B, each pixel 346 includes a plurality of subpixels (e.g.,subpixel 348, 350, 352, and 354), where each subpixel corresponds to arespective color. For example, each pixel may include three subpixels,each subpixel outputting light of one of red, green, and blue colors. Inanother example, each pixel may include four subpixels, each subpixeloutputting to one of red, green, blue, and yellow colors (e.g., subpixel348 outputs red light, subpixel 350 outputs green light, subpixel 352outputs blue light, and subpixel 354 outputs yellow light). In somecases, this is enabled by placing different color filters in front ofthe subpixels. In some embodiments, the subpixels in each pixel have thesame size (e.g., the red subpixel, the green subpixel, and the bluesubpixel have the same size), while in some other embodiments, thesubpixels have different sizes (e.g., to compensate for differentintensities of light of different colors).

In some embodiments, each tile 360 in the two-dimensional array of tileshas a same configuration. For example, each tile may have the same shapeand size, and include a same number of pixels. In some embodiments,tiles in the two-dimensional array of tiles have differentconfigurations (e.g., tiles having one of two different configurationsare alternated).

In some embodiments, each tile includes a two-dimensional array oflenses. For example, the tile may have the same number of pixels andlenses so that each pixel is coupled with a respective lens. In someembodiments, each single lens is integrated with a respective pixel(e.g., each single lens is placed on, or included as part of, therespective pixel).

FIG. 3C is a perspective view of tile 360 in accordance with someembodiments. As explained above, tile 360 includes two-dimensional array344 of pixels 346 and lens 342, which may be a lenslet of a microlensarray (e.g., microlens array 315 in FIG. 3A). In some embodiments, tile360 includes a single lens. In some other embodiments, tile 360 includestwo or more lenses along the optical axis (e.g., second lens 362 islocated between pixels 346 and lens 342).

FIG. 3D is a perspective view of a portion of the adjustable electronicdisplay element in accordance with some embodiments. The perspectiveview 380 includes a portion of the electronic display element and eyebox386. For example, the portion includes tiles 382A, 382B, and 382C, andlenslets 384A, 384B, and 384C in those tiles. In some cases, eyebox 386has a dimension of 10 mm×10 mm, although eyeboxes of different sizes canbe used. When pupil 330 is at position 388, the image is rendered forthis portion of eyebox 386, and light is directed from different tiles,including tiles 382A, 382B, and 382C to form an image on a retina of theeye.

FIGS. 3E-3G are schematic diagrams illustrating exemplary operations oftiles in accordance with some embodiments.

FIG. 3E illustrates three tiles (e.g., a first tile with group 344A ofpixels and lens 342A, a second tile with group 344B of pixels and lens342B, and a third tile with group 344C of pixels and lens 342C). Pixels344 in each tile render a respective pattern of light, which is directedby lens 342 in the tile to pupil 330 of eye 325. The respective patternof light from group 344A of pixels forms an image on a first portion332A of a retina of eye 325, the respective pattern of light from group344B of pixels forms an image on a second portion 332B of the retina ofeye 325, and the respective pattern of light from group 344C of pixelsforms an image on a third portion 332C of the retina of eye 325, asshown in FIG. 3G. Thus, the respective patterns of light from pixelgroups 344A, 344B, and 344C form a collective pattern of light, which isseamlessly projected onto the retina of eye 325, which is perceived bythe eye as a single image. In some embodiments, as shown in FIG. 3F, oneor more lenses (e.g., lens 342A and 342C) are tilted to better directlight toward pupil 330 of eye 325.

It should be noted that display devices described herein are distinctfrom what is known as light field displays. Light field displays projectpartially overlapping series of images. However, light field displayshave a limited field of view. In comparison, the disclosed displaydevices provide a large field of view that has not been possible withlight field displays, and therefore, can be used for a wider range ofapplications.

FIGS. 3H and 3I are schematic diagrams illustrating exemplary operationsof activating a subset of tiles in accordance with some embodiments.FIG. 3H illustrates an array of 5-by-5 tiles, where five tiles out ofthe 25 tiles are shown in the side view (e.g., tiles with pixel groups344D, 344A, 344B, 344C, and 344E and corresponding lenses 342D, 342A,342B, 342C, and 342E). As explained above with respect to FIGS. 3E-3G,the respective pattern of light from group 344A of pixels forms an imageon a first portion 332A of a retina of eye 325, the respective patternof light from group 344B of pixels forms an image on a second portion332B of the retina of eye 325, and the respective pattern of light fromgroup 344C of pixels forms an image on a third portion 332C of theretina of eye 325. However, group 344D of pixels and group 344E ofpixels are not activated. In some embodiments, group 344D of pixels andgroup 344E of pixels are not activated, because light output from group344D of pixels and group 344E of pixels cannot be directed to pupil 330of eye 325 (or because the light output from group 344D of pixels andgroup 344E of pixels cannot form an image on the retina of eye 325). Insome embodiments, group 344D of pixels and group 344E of pixels are notactivated, because the light output from group 344D of pixels and group344E of pixels are not necessary for forming an image on the retina ofeye 325. In some embodiments, group 344D of pixels and group 344E ofpixels are not activated, because light output from group 344D of pixelsand group 344E of pixels cannot be directed to pupil 330 of eye 325 (orbecause the light output from group 344D of pixels and group 344E ofpixels cannot form an image on the retina of eye 325). In someembodiments, the first portion 332A, the second portion 332B, and thethird portion 332C correspond to a fovea of eye 325 (e.g., the tiles areused for rendering images on the fovea).

In some embodiments, a group of pixels that is not activated does notoutput light toward the pupil of the eye. In some embodiments, a groupof pixels that is not activated does not output light at all. In someembodiments, a group of pixels that is not activated is turned off orremains in a power savings mode, thereby reducing consumption of energy.

FIG. 3H also illustrates that out of the twenty-five tiles, ninecontiguous tiles (including tiles 360A, 360B, and 360C) are activated(which are shaded in FIG. 3H) and the remaining sixteen tiles (includingtiles 360D and 360E) are not activated (which are not shaded in FIG.3H).

In some embodiments, as shown in FIG. 3I, one or more lenses (e.g., lens342A, 342C, 342D, and 342E) are tilted to better direct light towardpupil 330 of eye 325.

FIGS. 4A and 4B illustrate prophetic examples of correcting brightnessvariations in accordance with some embodiments.

FIG. 4A illustrates (on the left side) an image projected onto a retinaof an eye by a two-dimensional array of tiles (e.g., 5-by-5 array oftiles). As shown in FIG. 4A, in some cases, each portion of the imageprojected by a single tile has a variation in brightness (e.g., due tothe optics). For example, a mono-color image (e.g., an image of a bluesky or a white drywall), when projected onto the retina by thetwo-dimensional array of tiles, may have a variation in the brightness.To compensate for the variation in the brightness, the image is modifiedby the one or more processors (e.g., 216 in FIG. 2). For example, if thebrightness of pixels along the edges of each tile is higher than thebrightness of pixels in the middle of the tile, the brightness of pixelsalong the edges of the tile is reduced and/or the brightness of pixelsin the middle of the tile is increased, thereby providing a correcteddistribution of brightness across the tile. Conversely, if thebrightness of pixels along the edges of each tile is lower than thebrightness of pixels in the middle of the tile, the brightness of pixelsalong the edges of the tile is increased and/or the brightness of pixelsin the middle of the tile is reduced, thereby providing a correcteddistribution of brightness across the tile. The right side image in FIG.4A shows that the image formed on the retina based on the brightnesscorrection has no or reduced brightness variation.

FIG. 4B illustrates another example, in which an image of a person isprojected onto the retina of the eye by the two-dimensional array. Inthe left side image in FIG. 4B, the brightness variation reduces thequality of the image formed on the retina of the eye. The right sideimage in FIG. 4B shows that correcting the brightness variation improvesthe quality of the image formed on the retina of the eye.

Certain embodiments based on these principles are described below.

In accordance with some embodiments, display device 100 includes atwo-dimensional array of tiles (e.g., two-dimensional array 340 of tiles360 in FIG. 3B). Each tile (e.g., tile 360 in FIG. 3C) includes atwo-dimensional array of pixels (e.g., two-dimensional array 344 ofpixels 346 in FIG. 3C) and a lens (e.g., lens 342 in FIG. 3C), of atwo-dimensional array of lenses, configured to direct at least a portionof the respective pattern of light from two-dimensional array 344 ofpixels to a pupil of an eye of a user (e.g., FIG. 3E). Each pixel isconfigured to output light so that the two-dimensional array of pixelsoutputs a respective pattern of light (e.g., two-dimensional array 344Aof pixels in FIG. 3G outputs a pattern of light that corresponds to atop portion of a triangle, two-dimensional array 344B of pixels in FIG.3G outputs a pattern of light that corresponds to a middle portion ofthe triangle, and two-dimensional array 344C of pixels in FIG. 3Goutputs a pattern of light that corresponds to a bottom portion of thetriangle). The display device also includes one or more processors(e.g., processors 216 in FIG. 2) coupled with the two-dimensional arrayof tiles and configured to activate a subset of the two-dimensionalarray of tiles for outputting, from at least the subset of thetwo-dimensional array of tiles, a collective pattern of light that isdirected to the pupil of the eye of the user (e.g., the subset of thetwo-dimensional array of tiles is turned on or instructed to outputlight).

In some embodiments, the display device is a head-mounted display device(e.g., FIG. 1).

In some embodiments, the two-dimensional array of tiles is configured todirect the light from each pixel that outputs light to a pupil of an eyeof the user. For example, for any pixel that outputs light, at least aportion of the light output by the pixel is directed to the pupil of theeye of the user. This is distinct from light field displays, in whichcertain pixels output light that is not directed to the pupil of the eye(e.g., the light is sent to a direction other than a direction towardthe pupil of the eye). In some embodiments, tiles that cannot outputlight that can enter the pupil of the eye of the user (e.g., based onthe position of the pupil of the eye) are not activated (e.g., turnedoff).

In some embodiments, the collective pattern of light is configured toform an image on a retina of the eye of the user (e.g., the image formon the retina of the eye as shown in FIG. 3G).

In some embodiments, a first tile of the two-dimensional array of tilesoutputs a first pattern of light; a second tile, adjacent to the firsttile, of the two-dimensional array of tiles outputs a second pattern oflight; the first pattern of light corresponds to a first portion of theimage; the second pattern of light corresponds to a second portion ofthe image; and the first portion of the image does not overlap at leastpartially with the second portion of the image. For example, as shown inFIG. 3G, the first tile with group 344A of pixels outputs a pattern oflight that corresponds to the top portion of a triangle and the secondtile with group 344B of pixels, adjacent to (i.e., next to) the firsttile, outputs a pattern of light that corresponds to the middle portionof the triangle. As shown in FIG. 3G, a portion of the image formed bylight from group 344A of pixels and a portion of the image formed bylight from group 344B of pixels do not overlap. In some embodiments,these portions of the image do not overlap at all (e.g., there is noteven a partial overlap between the two portions) for a group of tilesfor a same eye. This is distinct from light field displays, which uselight output from pixels that are located apart to illuminate a samelocation on the retina of the eye.

In some embodiments, no two tiles (including two tiles that are adjacentto each other) output patterns of light that correspond to respectiveportions of the image that at least partially overlap with each other.As explained above, light output from each tile is used to project aunique portion of an image on the retina of the eye. Thus, light outputby any two different tiles forms portions of the image that do notoverlap with each other at all (e.g., the projected portions of theimage do not even partially overlap with each other, as shown in FIG.3G). However, in some embodiments, a tile configured for projecting aportion of a left-eye image to a left eye and a tile configured forprojecting a portion of a right-eye image to a right eye, and theleft-eye image and the right-eye image may partially overlap due to thestereoscopic nature of the left-eye image and the right-eye image forproviding depth perception.

In some embodiments, no two tiles, that are not adjacent to each other,output patterns of light that correspond to respective portions of theimage that at least partially overlap with each other. In suchembodiments, the portions of images projected by two adjacent tilespartially overlap (e.g., one or more edges of the portions of the imageoverlap) to ensure that there is no gap between the projected portionsof images.

In some embodiments, the two-dimensional array of tiles is arranged sothat a distance between two adjacent pixels in a first tile is distinctfrom a distance between a first pixel, in the first tile, that islocated closest to a second tile that is adjacent to the first tile anda second pixel, in the second tile, that is located closest to the firstpixel. For example, as shown in FIG. 3B, a pixel-to-pixel distancewithin a tile is different from a pixel-to-pixel distance between twoadjacent tiles (e.g., due to the portion of tile 360 not covered by thepixels 346, such as an area along a periphery of tile 360).

In some embodiments, the one or more processors are configured to adjustintensity of pixels (e.g., FIGS. 4A and 4B). In some embodiments, theone or more processors are configured to decrease the intensity ofpixels along an edge of each tile. In some embodiments, the one or moreprocessors are configured to increase the intensity of pixels at acenter of each tile. Alternatively, in some embodiments, the one or moreprocessors are configured to increase the intensity of pixels along anedge of each tile. In some embodiments, the one or more processors areconfigured to decrease the intensity of pixels at a center of each tile.

In some embodiments, the one or more processors are configured toactivate less than all of the tiles of the two-dimensional array oftiles. For example, processors 216 activate only a selection of tilesthat can direct light to the pupil of the eye (e.g., FIG. 3H). Incomparison, light field displays output light from all of the pixels,which is distinct from the claimed display devices.

In some embodiments, the subset of the two-dimensional array of tiles isa contiguous set of tiles of the two-dimensional array of tiles (e.g.,the contiguous set of tiles including tiles 360A, 360B, and 360C in FIG.3H).

In some embodiments, the two-dimensional array of tiles includes aleft-side array of tiles and a right-side array of tiles that does notoverlap with the left-side array of tiles. The one or more processorsare configured to activate less than all of the tiles of the left-sidearray of tiles for outputting a first pattern of light that is directedto a pupil of a left eye of the user (e.g., only tiles of the left-sidearray that can direct light to the pupil of the left eye are activatedand the remaining tiles of the left-side array are not activated) andactivate less than all of the tiles of the right-side array of tiles foroutputting a second pattern of light that is directed to a pupil of aright eye of the user (e.g., only tiles of the right-side array that candirect light to the pupil of the right eye are activated and theremaining tiles of the left-side array are not activated).

FIG. 5 is a flow diagram illustrating method 500 of activating a subsetof a two-dimensional array of tiles of a display device in accordancewith some embodiments. Method 500 is performed at a display device(e.g., display device 100 in FIG. 1) comprising a two-dimensional arrayof tiles (e.g., FIG. 3B). Each tile includes (e.g., FIG. 3C): atwo-dimensional array of pixels (e.g., 344), and a lens (e.g., 342), ofa two-dimensional array of lenses, configured to direct at least aportion of the respective pattern of light from the two-dimensionalarray of pixels to a pupil of an eye of a user (e.g., FIG. 3D). Eachpixel is configured to output light so that the two-dimensional array ofpixels outputs a respective pattern of light (e.g., FIG. 3G).

In some embodiments, prior to activating at least a subset of atwo-dimensional array of tiles, the device selects (502) the subset ofthe two-dimensional array of tiles for activation. For example, thedevice determines the subset of the two-dimensional array of tiles basedon a position of a pupil of an eye (e.g., the device determines theposition of the pupil of the eye, and the device selects the subset ofthe two-dimensional array of tiles based on the position of the pupil ofthe eye from a lookup table).

The device activates (504) at least the subset of the two-dimensionalarray of tiles of the display device for outputting, from at least thesubset of the two-dimensional array of tiles, a collective pattern oflight that is directed to a pupil of an eye of the user (e.g., FIG. 3G).For example, the device initiates sending power to the subset of thetwo-dimensional array of tiles. Alternatively, the device sendsinstructions to the subset of the two-dimensional array of tiles tooutput light. In some embodiments, the device activates only a subset ofthe two-dimensional array of tiles for outputting, from the subset ofthe two-dimensional array of tiles, a collective pattern of light thatis directed to a pupil of an eye of the user. In some embodiments, thedevice deactivates (e.g., turns off or places in a power savings mode)the rest of the two-dimensional array of tiles.

In some embodiments, the device directs (506) the light, from each pixelthat outputs light, to a pupil of an eye of the user. For example, lightfrom each pixel that outputs light is directed through a microlenstoward the pupil of the eye of the user, as shown in FIG. 3D. Indetermining whether the device directs the light from each pixel thatoutputs light to the pupil of the eye, pixels that do not output lightare not considered.

In some embodiments, activating at least the subset of thetwo-dimensional array of tiles includes (508) activating less than allof the tiles of the two-dimensional array of tiles. Activating less thanall of the tiles of the two-dimensional array of tiles has an additionaladvantage in reducing the power consumption, thereby increasing theinterval between battery charges.

FIG. 6A is a schematic diagram illustrating lens assembly 604 inaccordance with some embodiments. Lens assembly 604 is configured todirect at least a portion of a pattern of light from a two-dimensionalarray of pixels 602 to a pupil of an eye of a user. For example, lensassembly 604 projects an image on two-dimensional array of pixels 602onto a retina of the eye of the user. In some embodiments, the imageprojected on the retina of the eye of the user is a demagnified image ofthe image on two-dimensional array of pixels 602 (e.g., a size of theimage projected on the retina of the eye of the user is smaller than asize of the image on two-dimensional array of pixels 602). This reducesvisibility of the spacing between pixels (or sub-pixels) oftwo-dimensional array of pixels 602, which is often called a screen dooreffect.

FIG. 6B is a zoomed-in view of lens assembly 604 shown in FIG. 6A.

Lens assembly 604 includes multiple distinct optical elements. In someembodiments, lens assembly 604 includes two or more lenses. In someembodiments, lens assembly 604 includes three or more lenses, such aslens 606, lens 608, and lens 610, as shown in FIG. 6B. As shown in FIG.6B, lens 606 and lens 608 are divergent lenses (e.g., plano-concavelenses) and lens 610 is a convergent lens (e.g., a plano-convex lens).The use of multiple lenses allows large demagnification, such as ¼×demagnification). In some embodiments, curved surfaces of the lenses areaspheric surfaces. This allows a high modulation transfer function.

In some embodiments, lens assembly 604 includes a configuration of aninverted telescope (e.g., an inverted refracting telescope). In someembodiments, lens assembly 604 includes a configuration of an inverseGalileo telescope (e.g., a combination of a divergent lens and aconvergent lens), as shown in FIG. 6B. In some embodiments, lensassembly 604 includes a configuration of an inverse Keplerian telescope(e.g., a combination of two or more convergent lenses).

Although lenses 606, 608, and 610 are illustrated as single lenses inFIG. 6B, in some embodiments, one or more of lenses 606, 608, and 610are included in one or more lens arrays. For example, the display device(e.g., 100, FIG. 1) includes three separate lens arrays (e.g., arrays620, 630, and 640), which collectively form an array of lens assemblies,as shown in FIG. 6C. First array 620 includes a first lens (e.g., lens606). Second array 630 is distinct and separate from first array 620 andincludes a second lens (e.g., lens 608). Third array 640 is distinct andseparate from first array 620 and second array 630, and includes a thirdlens (e.g., lens 610). The first lens, the second lens, and the thirdlens are included in a same lens assembly of a respective tile.

In some embodiments, a lens assembly includes baffles to reducecross-talk. For example, one or more baffles reduce transmission oflight from two-dimensional array of pixels 602 to lens 616, transmissionof light from lens 606 to lens 618, transmission of light from 616 tolens 608, transmission of light from lens 608 to lens 622, and/ortransmission of light from lens 618 to lens 610. Additionally oralternatively, in some cases, lenses in a respective array areconfigured so that a light entering one lens of the respective array isnot transmitted to one or more adjacent lenses within the samerespective array. For example, transmission of light from lens 606 toadjacent lens 616 (e.g., due to leaking, scattering, etc.) is reduced bya baffle. Similarly, transmission of light from lens 608 to adjacentlens 618 and transmission of light from lens 610 to adjacent lens 622are reduced by one or more baffles.

In some embodiments, lens 606 and lens 616 are identically configured(e.g., lens 606 and lens 616 have a same focal length). In someembodiments, lens 606 and lens 616 are configured differently (e.g.,lens 606 have lens 616 have different focal lengths). In someembodiments, lens 608 and lens 618 are identically configured (e.g.,lens 608 and lens 618 have a same focal length). In some embodiments,lens 608 and lens 618 are configured differently (e.g., lens 608 andlens 618 have different focal lengths). In some embodiments, lens 610and lens 622 are identically configured (e.g., lens 610 and lens 622have a same focal length). In some embodiments, lens 610 and lens 622are configured differently (e.g., lens 610 and lens 622 have differentfocal lengths).

FIG. 6D is a schematic diagram illustrating a magnification device(e.g., an image magnification or demagnification device) with lensassemblies in accordance with some embodiments. In some embodiments, themagnification device is configured to provide one of predefinedmagnification factors. In some embodiments, the magnification device isconfigured to select one of predefined magnification factors.

FIG. 6D illustrates a first group of lens assemblies (e.g., lensassemblies 642-1, 642-3, and 642-5) and a second group of lensassemblies (e.g., lens assemblies 642-2, 642-4, and 642-6). The firstgroup of lens assemblies includes lens assembly 642-1, lens assembly642-3, and lens assembly 642-5, and the second group of lens assembliesincludes lens assembly 642-2, lens assembly 642-4, and lens assembly642-6. Respective lens assemblies of the first group of lens assembliesare configured to provide a first magnification (e.g., 1×), andrespective lens assemblies of the second group of lens assemblies areconfigured to provide a second magnification (e.g., 0.5×) that isdistinct from the first magnification.

As shown in FIG. 6D, each of these lens assemblies includes two or morelenses. For example, lens assembly 642-1 includes lenses 644-1 and648-1, lens assembly 642-2 includes lenses 646-1 and 650-1, lensassembly 642-3 includes lenses 644-2 and 648-2, lens assembly 642-4includes lenses 646-2 and 650-2, lens assembly 642-5 includes lenses644-3 and 648-3, and lens assembly 642-6 includes lenses 646-3 and650-3.

FIG. 6D also illustrates that the magnification device includes spatiallight modulator 652 configured to selectively reduce transmission oflight through the two-dimensional array of lens assemblies. For example,spatial light modulator 652 includes a plurality of pixels 654. In someembodiments, the plurality of pixels 654 is aligned with the lensassemblies (e.g., pixel 654-1 is aligned with lens assembly 642-1, pixel654-2 is aligned with lens assembly 642-2, pixel 654-3 is aligned withlens assembly 642-3, pixel 654-4 is aligned with lens assembly 642-4,pixel 654-5 is aligned with lens assembly 642-5, and pixel 654-6 isaligned with lens assembly 642-6). In some embodiments, each of pixels654 is configured to selectively transmit or block (or reduce intensityof) light passing through the pixel (e.g., pixel 654-1 is configured totransmit or block light passing through pixel 654-1 based on electricalsignal applied to pixel 654-1). For example, in some cases, a pixel(e.g., pixel 654-1) is configured to transmit light independent ofwhether an adjacent pixel (e.g., pixel 654-2) is configured to transmitlight through the adjacent pixel (e.g., pixel 654-2) or block (or reduceintensity of) light. In some embodiments, a pixel is selectivelyconfigured to transmit light independent of whether the other pixels areconfigured to transmit or block (or reduce intensity of) light. In someembodiments, spatial light modulator is configured to concurrently block(or reduce) transmission of light for the first group of lens assembliesand allow transmission of light for the second group of lens assembliesat a first time (e.g., pixels 654-1, 654-3, and 654-5 are configured toblock (or reduce) transmission of light for lens assemblies 642-1,642-3, and 642-5 and pixels 654-2, 654-4, and 654-6 are configured toallow transmission of light for lens assemblies 642-2, 642-4, and642-6), and concurrently block (or reduce) transmission of light for thesecond group of lens assemblies and allow transmission of light for thefirst group of lens assemblies at a second time that is distinct andseparate from the first time (e.g., pixels 654-2, 654-4, and 654-6 areconfigured to block (or reduce) transmission of light for lensassemblies 642-2, 642-4, and 642-6 and pixels 654-1, 654-3, and 654-5are configured to allow transmission of light for lens assemblies 642-1,642-3, and 642-5).

In some embodiments, one or more baffles 656 are positioned betweenadjacent lens assemblies. For example, one or more baffles 656 arepositioned between lens assemblies 642-1 and 642-2, one or more baffles656 are positioned between lens assemblies 642-2 and 642-3, one or morebaffles 656 are positioned between lens assemblies 642-3 and 642-4, oneor more baffles 656 are positioned between lens assemblies 642-4 and642-5, and one or more baffles 656 are positioned between lensassemblies 642-5 and 642-6. In some embodiments, the one or more baffles656 are configured to reduce transmission of light between lensassemblies 642 (e.g., one of more baffles 656 reduce transmission oflight between lens assemblies 642-1 and 642-2). In some embodiments, theone or more baffles 656 are configured to reduce transmission of lightamong microlenses (e.g., one or more baffles 656 reduce transmission oflight between lens 644-1 and 646-1 and between lens 644-1 and 650-1).

As shown in FIG. 6D, in some embodiments, a size (e.g., width ordiameter) of lens 644 is the same as a size of lens 648. In someembodiments, a size of lens 646 is the same as a size of lens 650. Insome embodiments, the size of lens 644 is different from the size oflens 648. In some embodiments, the size of lens 646 is different fromthe size of lens 650.

FIG. 6E is a schematic diagram illustrating a magnification device withlens assemblies in accordance with some embodiments.

FIG. 6E is similar to 6D, except that lenses 644-1, 646-1, 644-2, 646-2,644-3, and 646-3 are integrated. For example, lenses 644-1, 646-1,644-2, 646-2, 644-3, and 646-3 are integrally formed (e.g., in a singleplastic molding process). As a result, lens array 620 includes lenses644-1, 646-1, 644-2, 646-2, 644-3, and 646-3. Similarly, in FIG. 6E,lenses 648-1, 650-1, 648-2, 650-2, 648-3, and 650-3 are integrated. Forexample, lenses 648-1, 650-1, 648-2, 650-2, 648-3, and 650-3 areintegrally formed (e.g., in a single plastic molding process). As aresult, lens array 630 includes lenses 648-1, 650-1, 648-2, 650-2,648-3, and 650-3.

FIG. 6F is a schematic diagram illustrating a magnification device withlens assemblies in accordance with some embodiments.

FIG. 6F is similar to FIG. 6E, except that the lens assemblies alsoinclude a third group of lens assemblies (e.g., lens assemblies 642-7,642-8, and 642-9).

As shown in FIG. 6F, respective lens assemblies of the third group oflens assemblies include two or more lenses. For example, lens assembly642-7 includes lenses 658-1 and 660-1, lens assembly 642-8 includeslenses 658-2 and 660-2, lens assembly 642-9 includes lenses 658-3 and660-3. Respective lens assemblies of the third group of lens assembliesare configured to provide a third magnification (e.g., 0.25×) that isdistinct from the first magnification (e.g., 1×) and the secondmagnification (e.g., 0.5×).

In some embodiments, spatial light modulator is configured toconcurrently block (or reduce) transmission of light for the second andthird groups of lens assemblies and allow transmission of light for thefirst group of lens assemblies at a first time (e.g., pixels 654-2,654-4, 654-6, 654-7, 654-8, and 654-9 are configured to block (orreduce) transmission of light for lens assemblies 642-2, 642-4, 642-6,642-7, 642-8, and 642-9 and pixels 654-1, 654-3, and 654-5 areconfigured to allow transmission of light for lens assemblies 642-1,642-3, and 642-5), concurrently block (or reduce) transmission of lightfor the first and third groups of lens assemblies and allow transmissionof light for the second group of lens assemblies at a second time thatis distinct and separate from the first time (e.g., pixels 654-1, 654-3,654-5, 654-7, 654-8, and 654-9 are configured to block (or reduce)transmission of light for lens assemblies 642-1, 642-3, 642-5, 642-7,642-8, and 642-9 and pixels 654-2, 654-4, and 654-6 are configured toallow transmission of light for lens assemblies 642-2, 642-4, and642-6), and concurrently block (or reduce) transmission of light for thefirst and second groups of lens assemblies and allow transmission oflight for the second group of lens assemblies at a third time that isdistinct and separate from the first time and the second time (e.g.,pixels 654-1, 654-2, 654-3, 654-4, 654-5, and 654-6 are configured toblock (or reduce) transmission of light for lens assemblies 642-1,642-2, 642-3, 642-4, 642-5, and 642-6 and pixels 654-7, 654-8, and 654-9are configured to allow transmission of light for lens assemblies 642-7,642-8, and 642-9).

Although FIG. 6F illustrate a magnification device with three groups oflens assemblies, each group configured to provide differentmagnification, the magnification device may include four or more groupsof lens assemblies, each group configured to provide differentmagnification.

As shown in FIG. 6F, in some embodiments, a size of lens 658 is the sameas a size of lens 660. In some embodiments, the size of lens 658 isdifferent from the size of lens 660.

FIG. 6G is a schematic diagram illustrating a magnification device withlens assemblies in accordance with some embodiments.

FIG. 6G is similar to FIG. 6F except that the lens assemblies alsoinclude lens array 640. Lens assembly 640 includes lenses 662-1, 662-2,and 662-3. As shown in FIG. 6G, in some embodiments, a size of lens662-1 (e.g., width or diameter) is larger than a size of each of lenses648-1, 650-1, and 660-1.

In some embodiments, lenses 662 are integrated. For example, lenses 662(e.g., 662-1, 662-2, and 662-3) are integrally formed into single lensarray 640.

FIG. 6H is a schematic diagram illustrating a magnification device withlens assemblies in accordance with some embodiments.

FIG. 6H is similar to FIG. 6G except that lens array 640 includes lenses664-1, 666-1, 668-1, 664-2, 666-2, 668-2, 664-3, 666-3, and 668-3. Insome embodiments, a single lens assembly includes a lens of lens array620 (e.g., lens 644-1), a lens of lens array 630 (e.g., lens 648-1), anda lens of lens array 640 (e.g., lens 664-1).

As shown in FIG. 6H, in some embodiments, a size (e.g., width ordiameter) of lens 644 is the same as a size of lens 664. In someembodiments, a size of lens 646 is the same as a size of lens 666. Insome embodiments, a size of lens 658 is the same as a size of lens 668.In some embodiments, the size of lens 644 is different from the size oflens 664. In some embodiments, the size of lens 646 is different fromthe size of lens 666. In some embodiments, the size of lens 658 isdifferent from the size of lens 668.

Although FIGS. 6D-6I depict spatial light modulator 652 placed adjacentto an entrance of lens assemblies for blocking (or reducing) lighttransmitted toward the lens assemblies, in some embodiments, spatiallight modulator 652 is placed adjacent to an exit of lens assemblies forblocking (or reducing) light emerging from one or more lens assemblies,as shown in FIG. 6I.

FIG. 6I is a schematic diagram illustrating a display device with lensassemblies in accordance with some embodiments.

The display device includes, for each tile, two-dimensional array ofpixels 602, lenses of first lens array 620, lenses of second lens array630, and a lens of third lens array 610. The lenses of first lens array620, the lenses of second lens array 630, and the lens of third lensarray 610 collectively include first, second, and third lens assemblies,each configured to provide a different magnification factor (e.g.,magnification, which corresponds to a magnification factor greater than1×; no magnification, which corresponds to a magnification factor of 1×;and/or demagnification, which corresponds to a magnification factor lessthan 1×). Thus, by selectively reducing transmission of light enteringone or more lens assemblies or emerging from the one or more lensassemblies, one of the lens assemblies is used for transmission oflight. In FIG. 6I, spatial light modulator 652 is configured to block orreduce transmission of light for two of the three lens assemblies (e.g.,top and bottom lens assemblies) and light is transmitted through theremaining lens assembly (e.g., the middle lens assembly) and projectedwith magnification associated with the remaining lens assembly. Whendifferent magnification is desired, spatial light modulator 652 isconfigured to allow transmission of light through a different lensassembly that is configured to provide different magnification.

Although arrangements of lens assemblies in one dimension are depictedin FIGS. 6D-6I, in some embodiments, the lens assemblies are arranged intwo dimensions as shown in FIG. 6J. FIG. 6J is a schematic diagramillustrating an elevation view of a two-dimensional array of lensassemblies in accordance with some embodiments. As shown in FIG. 6J, foreach tile, a lens assembly of the first group (e.g., lens assembly642-1), a lens assembly of the second group (e.g., lens assembly 642-2),and a lens assembly of the third group (e.g., lens assembly 642-7) arearranged in two dimensions (e.g., lens assemblies 642-1, 642-2, and642-7 are not linearly arranged).

Certain embodiments based on these principles are described below. Someof the details described above are not repeated for brevity.

In accordance with some embodiments, a magnification device includes atwo-dimensional array of lens assemblies. The two-dimensional array oflens assemblies includes a first group of multiple lens assemblies of afirst magnification (e.g., lens assemblies 642-1, 642-3, and 642-5 inFIG. 6E) and a second group of multiple lens assemblies of a secondmagnification that is distinct from the first magnification (e.g., lensassemblies 642-2, 642-4, and 642-6 in FIG. 6E). The first group ofmultiple lens assemblies of the first magnification includes a firstlens assembly (e.g., lens assembly 642-1), and a second lens assembly(e.g., lens assembly 642-3) that is distinct and separate from the firstlens assembly. The second group of multiple lens assemblies of thesecond magnification includes a third lens assembly (e.g., lens assembly642-2) that is distinct and separate from the first lens assembly andthe second lens assembly; and a fourth lens assembly (e.g., lensassembly 642-4) that is distinct and separate from the first lensassembly, the second lens assembly, and the third lens assembly. Each ofthe first lens assembly, the second lens assembly, the third lensassembly, and the fourth lens assembly includes two or more lenses(e.g., lens assembly 642-1 includes lens 644-1 and lens 648-1 as shownin FIG. 6E). The device also includes a spatial light modulatorconfigured to selectively reduce (e.g., including blocking) transmissionof light for the two-dimensional array of lens assemblies (e.g., spatiallight modulator 652 in FIG. 6E).

In some embodiments, the spatial light modulator is configured toconcurrently block or reduce transmission of light for the first lensassembly and the second lens assembly or the third lens assembly and thefourth lens assembly. For example, in FIG. 6E, pixels 654-1 and 654-3(and pixel 654-5) are configured to concurrently block transmission oflight while pixels 654-2 and 654-4 (and pixel 654-6) are configured toconcurrently allow transmission of light at a first time, pixels 654-2and 654-4 (and pixel 654-6) are configured to concurrently blocktransmission of light while pixels 654-1, 654-3, and 654-5 areconfigured to concurrently allow transmission of light at a second timethat is distinct and separate from the first time (e.g., the second timedoes not overlap with the first time).

In some embodiments, the third lens assembly is located between thefirst lens assembly and the second lens assembly (e.g., in FIG. 6E, lensassembly 642-2 is located between lens assemblies 642-1 and 642-3); andthe second lens assembly is located between the third lens assembly andthe fourth lens assembly (e.g., in FIG. 6E, lens assembly 642-3 islocated between lens assemblies 642-2 and 642-4).

In some embodiments, the two-dimensional array of lens assemblies alsoincludes a third group of multiple lens assemblies of a thirdmagnification that is distinct from the first magnification and thesecond magnification (e.g., lens assemblies 642-7, 642-8, and 642-9 inFIG. 6F). The third group of multiple lens assemblies includes a fifthlens assembly (e.g., lens assembly 642-7) that is distinct and separatefrom the first lens assembly, the second lens assembly, the third lensassembly, and the fourth lens assembly, and a sixth lens assembly (e.g.,lens assembly 642-8) that is distinct and separate from the first lensassembly, the second lens assembly, the third lens assembly, the fourthlens assembly, and the fifth lens assembly.

In some embodiments, the fifth lens assembly is located between thethird lens assembly and the second lens assembly (e.g., in FIG. 6F, lensassembly 642-7 is located between lens assemblies 642-2 and 642-3); andthe second lens assembly and the fourth lens assembly are locatedbetween the fifth lens assembly and the sixth lens assembly (e.g., lensassemblies 642-3 and 642-4 are located between lens assemblies 642-7 and642-8).

In some embodiments, the fifth lens assembly is located between thefirst lens assembly and the second lens assembly (e.g., in FIG. 6F, lensassembly 642-7 is located between lens assemblies 642-1 and 642-3); andthe second lens assembly and the fourth lens assembly are locatedbetween the fifth lens assembly and the sixth lens assembly (e.g., lensassemblies 642-3 and 642-4 are located between lens assemblies 642-7 and642-8).

In some embodiments, each lens assembly includes at least two lenses.For example, in FIG. 6E, each lens assembly includes two lenses (e.g.,lens assembly 642-1 includes lenses 644-1 and 648-1).

In some embodiments, each lens assembly includes at least three lenses.For example, in FIG. 6H, a particular lens assembly includes threelenses 644-1, 648-1, and 664-1.

In some embodiments, the device includes a first microlens array (e.g.,lens array 620 in FIG. 6E) and a second microlens array (e.g., lensarray 630) that is distinct from the first microlens array. Each lensassembly includes at least one microlens of the first microlens arrayand at least one microlens of the second microlens array (e.g., lensassembly 642-1 includes lens 644-1 of lens array 620 and lens 648-1 oflens array 630).

In some embodiments, the first microlens array includes a plurality ofmicrolenses arranged in multiple dimensions (e.g., lens array 620includes lenses 644-1, 646-1, 644-2, 646-2, 644-3, and 646-3 andadditional lenses in a dimension not depicted in FIG. 6E); the secondmicrolens array includes a plurality of microlenses arranged in multipledimensions (e.g., lens array 630 includes lenses 648-1, 650-1, 648-2,650-2, 648-3, and 650-3 and additional lenses in a dimension notdepicted in FIG. 6E); and a respective lens of the first microlens arrayis aligned with a corresponding lens of the second microlens array(e.g., lens 646-1 is aligned with lens 650-1 in FIG. 6E).

In some embodiments, the first microlens array includes a plurality ofmicrolenses of a first focal length (e.g., lenses 644-1, 644-2, and644-3 in FIG. 6E) and a plurality of microlenses of a second focallength that is distinct from the first focal length (e.g., lenses 646-1,646-2, and 646-3 in FIG. 6E). The microlenses of the first focal lengthare interspersed with the microlenses of the second focal length (e.g.,lens 646-1 is located between lenses 644-1 and 644-2 and lens 644-2 islocated between lenses 646-1 and 646-2).

In some embodiments, the first microlens array also includes a pluralityof microlenses of a third focal length that is distinct from the firstfocal length and the second focal length (e.g., lenses 658-1, 658-2, and658-3 in FIG. 6F). The microlenses of the third focal length areinterspersed with the microlenses of the first focal length and themicrolenses of the second focal length (e.g., lens 658-1 is locatedbetween lenses 646-1 and 644-2 and lenses 644-2 and 646-2 are locatedbetween lenses 658-1 and 658-2).

In some embodiments, the second microlens array includes a plurality ofmicrolenses of a fourth focal length (e.g., lenses 648-1, 648-2, and648-3 in FIG. 6E) and a plurality of microlenses of a fifth focal lengththat is distinct from the fourth focal length (e.g., lenses 650-1,650-2, and 650-3 in FIG. 6E). The microlenses of the fourth focal lengthare interspersed with the microlenses of the fifth focal length (e.g.,lens 650-1 is located between lenses 648-1 and 648-2 and lens 648-2 islocated between lenses 650-1 and 650-2).

In some embodiments, the second microlens array also includes aplurality of microlenses of a sixth focal length that is distinct fromthe fourth focal length and the fifth focal length (e.g., lenses 660-1,660-2, and 660-3 in FIG. 6F). The microlenses of the sixth focal lengthare interspersed with the microlenses of the fourth focal length and themicrolenses of the fifth focal length (e.g., lens 660-1 is locatedbetween lens 650-1 and 648-2 and lenses 648-2 and 650-2 are locatedbetween lenses 660-1 and 660-2).

In some embodiments, the device includes a third microlens array (e.g.,lens array 640 in FIG. 6G). Each lens assembly also includes at leastone microlens of the third microlens array in addition to the at leastone microlens of the first lens array and the at least one microlens ofthe second microlens array (e.g., in FIG. 6G, a first lens assemblyincludes lenses 644-1, 648-1, and 662-1 and a second lens assemblyincludes lenses 646-1, 650-1, and 662-1, and in FIG. 6H, a third lensassembly includes lenses 644-1, 648-1, and 664-1 and a fourth lensassembly includes lenses 646-1, 650-1, and 666-1).

In some embodiments, the third microlens array includes a plurality ofmicrolenses arranged in multiple dimensions (e.g., lenses 662-1, 662-2,and 662-3 and additional lenses in a dimension not depicted in FIG. 6G).A respective lens of the third microlens array is aligned with acorresponding lens of the first microlens array (e.g., lens 662-1 isaligned with lens 646-1 in FIG. 6G).

In some embodiments, the third microlens array includes a plurality ofmicrolenses of a seventh focal length (e.g., lenses 664-1, 664-2, and664-3 in FIG. 6H) and a plurality of microlenses of an eighth focallength that is distinct from the seventh focal length (e.g., lenses666-1, 666-2, and 666-3). The microlenses of the seventh focal lengthare interspersed with the microlenses of the eighth focal length (e.g.,lens 666-1 is located between lenses 664-1 and 664-2 and lens 664-2 islocated between lenses 666-1 and 666-2).

In some embodiments, the third microlens array also includes a pluralityof microlenses of a ninth focal length that is distinct from the seventhfocal length and the eighth focal length (e.g., lenses 668-1, 668-2, and668-3 in FIG. 6H). The microlenses of the ninth focal length areinterspersed with the microlenses of the seventh focal length and themicrolenses of the eighth focal length (e.g., lens 668-1 is locatedbetween lenses 666-1 and 664-2 and lenses 664-2 and 666-2 are locatedbetween lenses 668-1 and 668-2).

In some embodiments, the device includes one or more baffles configuredto reduce transmission of light among microlenses on a respectivemicrolens array (e.g., baffles 656 in FIG. 6D).

In accordance with some embodiments, a display device includes any ofthe magnification devices (e.g., a device that includes multiple lensassemblies) described above; and a two-dimensional array of tiles. Eachtile includes a two-dimensional array of pixels (e.g., two-dimensionalarray 602 of pixels in FIG. 6I). Each pixel is configured to outputlight so that the two-dimensional array of pixels outputs a respectivepattern of light. Each tile also includes a lens assembly, of the firstgroup of multiple lens assemblies of the two-dimensional array of lensassemblies of the device, configured to provide the first magnification(e.g., a lens assembly that includes lenses 644-1 and 648-1 in FIG. 6H);and a lens assembly, of the second group of multiple lens assemblies ofthe two-dimensional array of lens assemblies of the device, configuredto provide the second magnification (e.g., a lens assembly that includeslenses 646-1 and 650-1 in FIG. 6H).

In some embodiments, each tile of the two-dimensional array of tilesincludes a lens assembly, of a third group of multiple lens assembliesof the two-dimensional array of lens assemblies of the device,configured to provide a third magnification that is distinct from thefirst magnification and the second magnification (e.g., a lens assemblythat includes lenses 658-1 and 660-1 in FIG. 6H).

In accordance with some embodiments, a method is performed at a displaydevice comprising a spatial light modulator and a two-dimensional arrayof tiles. Each tile includes a two-dimensional array of pixels. Eachpixel is configured to output light so that the two-dimensional array ofpixels outputs a respective pattern of light. Each tile also includes alens assembly, of a first group of multiple lens assemblies of atwo-dimensional array of lens assemblies, configured to provide a firstmagnification, and a lens assembly, of a second group of multiple lensassemblies of the two-dimensional array of lens assemblies, configuredto provide a second magnification that is distinct from the firstmagnification. The method includes activating the spatial lightmodulator to reduce transmission of light for the lens assembly of thefirst group of multiple lens assemblies and allow transmission of lightfor the lens assembly of the second group of multiple lens assemblies(e.g., in FIG. 6E, switching on pixels 654-1 and 654-3 to block orreduce transmission of light through lens assemblies 642-1 and 642-3 andswitching off pixels 654-2 and 654-4 to allow transmission of lightthrough lens assemblies 642-2 and 642-4). The method also includes,subsequent to activating the spatial light modulator to reducetransmission of light for the lens assembly of the first group ofmultiple lens assemblies and allow transmission of light for the lensassembly of the second group of multiple lens assemblies, activating thespatial light modulator to reduce transmission of light for the lensassembly of the second group of multiple lens assemblies and allowtransmission of light for the lens assembly of the first group ofmultiple lens assemblies (e.g., in FIG. 6E, switching off pixels 654-1and 654-3 to allow transmission of light through lens assemblies 642-1and 642-3 and switching on pixels 654-2 and 654-4 to block or reducetransmission of light through lens assemblies 642-2 and 642-4).

FIG. 7A is a cross-sectional view of a beam deflector device inaccordance with some embodiments.

In FIG. 7A, the beam deflector device includes a single integratedsubstrate 700, which includes a first array of light-steering components(e.g., 706, 708, 712, and 714) and a second array of light-steeringcomponents (e.g., 702, 704, 716, and 718).

In some embodiments, some of the light-steering components are prisms.In some embodiments, all of the light-steering components are prisms.However, at least some of the light-steering components need not beprisms. One of ordinary skill will appreciate that light-steeringcomponents other than prisms may be used in conjunction with prisms,without departing from the scope of the invention. In some embodiments,some of the light-steering components have a shape of a wedge. In someembodiments, all of the light-steering components have a shape of awedge.

In some embodiments, a prism refers to an optical element with at leasttwo non-parallel flat optical surfaces (e.g., an entrance surface and anapex surface). As used herein, a flat optical surface refers to asurface that is represented by a straight line in a cross-sectional view(taken from a surface that passes through a center of the prism). Forexample, a flat optical surface includes a planar surface (e.g., asurface of a cube). In another example, a flat optical surface includesa circumferential surface of a cylinder or a cone, as thecircumferential surface is represented by a straight line in across-sectional view of the cylinder or the cone. In a prism, the apexsurface is a surface that a light entering the prism through theentrance surface at an angle that is perpendicular to the entrancesurface reaches immediately subsequent to entering the prism through theentrance surface (e.g., before reaching any other surface of the prism).

In FIG. 7A, the beam deflector device is, for convenience ofdescription, segmented into subsections that correspond tolight-steering components, such as prisms 702, 704, 706, 708, 710, 712,714, 716, and 718 and connecting regions 703, 705, 715, and 717.

The single integrated substrate 700 includes a planar entrance surface790 and a non-planar exit surface that is opposite to the planarentrance surface 790. In FIG. 7A, the prisms 702, 704, 706, 708, 712,714, 716, and 718 are located on the non-planar exit surface.

The beam deflector device includes a first array of light-steeringcomponents, such as prisms 706, 708, 712, and 714, that are located atrespective distances less than a predefined distance 777 from areference point (or a reference axis 701). For example, the distancebetween the reference axis 701 and each of prisms 706, 708, 712, and 714is less than the predefined distance 777. The single integratedsubstrate 700 also includes a second array of light-steering components,such as prisms 702, 704, 716, and 718, that are located at respectivedistances greater than the predefined distance 777 from the referencepoint (or the reference axis 701).

The prism 706, of the first array of light-steering components, has anentrance surface 706D and an apex surface 706A. The prism 706 has anapex angle 706X that is defined by the entrance surface 706D and theapex surface 706A (e.g., an angle formed by the entrance surface 706Dand the apex surface 706A corresponds to the apex angle 706X).

Similarly, the prism 708 has an entrance surface 708D and an apexsurface 702A. The prism 708 has an apex angle 708X that is defined bythe entrance surface 708D and the apex surface 708A. The prism 712 hasan entrance surface 712D and an apex surface 702A. The prism 712 has anapex angle that is defined by the entrance surface 712D and the apexsurface 712A. The prism 714 has an entrance surface 714D and an apexsurface 702A. The prism 714 has an apex angle that is defined by theentrance surface 714D and the apex surface 714A.

The prism 702, of the second array of light-steering components, has anentrance surface 702D, an apex surface 702A, and the exit surface 702C.In FIG. 7A, the prism 702 also includes an optional surface 702B (e.g.,in some cases, the prism 702 does not include the surface 702B and theapex surface 702A is in direct contact with the exit surface 702C). Theprism 702 has an apex angle 702X that is defined by the entrance surface702D and the apex surface 702A (e.g., an angle formed by the entrancesurface 702D and the apex surface 702A corresponds to the apex angle702X).

Similarly, the prism 704 has an entrance surface 704D, an apex surface704A, and the exit surface 704C. The prism 704 optionally includes asurface 704B. The prism 704 has an apex angle 704X that is defined bythe entrance surface 704D and the apex surface 704A. The prism 716 hasan entrance surface 716D, an apex surface 716A, and the exit surface716C. The prism 716 optionally includes a surface 716B. The prism 716has an apex angle that is defined by the entrance surface 716D and theapex surface 716A. The prism 718 has an entrance surface 718D, an apexsurface 718A, and the exit surface 718C. The prism 718 optionallyincludes a surface 718B. The prism 718 has an apex angle that is definedby the entrance surface 718D and the apex surface 718A.

The prisms of the first array of light-steering components (e.g., theprisms 706, 708, 712 and 714) have an apex angle that is less than acritical angle (e.g., the apex angle 706X is less than the criticalangle and the apex angle 708X is less than the critical angle). In someembodiments, the critical angle θ_(c) corresponds to arcsin(1/n), wheren is a refractive index of the prism (e.g., the refractive index of amaterial of the prism). For example, polymethyl methacrylate (e.g.,acrylic glass) has a refractive index of 1.4905 at 589.3 nm, and thecritical angle of polymethyl methacrylate is approximately 42 degrees(for a light having a wavelength of 589.3 nm).

The apex angle 708X of the prism 708 is distinct from the apex angle706X of the prism 706 (e.g., the apex angle 706X of the prism 706 isgreater than the apex angle 708X of the prism 708).

The prisms of the second array of light-steering components (e.g., theprisms 702, 704, 716, and 718) have an apex angle that is greater thanthe critical angle (e.g., the apex angle 702X is greater than thecritical angle and the apex angle 704X is greater than the criticalangle).

In some embodiments, the apex angle 702X of the prism 702 is distinctfrom the apex angle 704X of the prism 704 (e.g., the apex angle 702X ofthe prism 702 is greater than the apex angle 704X of the prism 704).

In some embodiments, an apex angle of a prism of the second array oflight-steering components is less than an angle formed by an entrancesurface and an exit surface of the prism (e.g., the apex angle 702X ofthe prism 702 is less than the angle formed by the entrance surface 702Dand the exit surface 702C, and the apex angle 704X of the prism 704 isless than the angle formed by the entrance surface 704D and the exitsurface 704C).

In some embodiments, the cross-section of the beam deflector device issymmetric (e.g., the prism 712 is a mirror image of the prism 708, theprism 714 is a mirror image of the prism 706, the prism 716 is a mirrorimage of the prism 704, and the prism 718 is a mirror image of the prism702).

In some embodiments, the single integrated substrate 700 includes aregion 710 that has two parallel flat optical surfaces (e.g., anentrance surface 710D and an exit surface 710A). In some embodiments,the region 710 corresponds to a through hole (e.g., the singleintegrated substrate 700 has a through hole for the region 710).

In some embodiments, the single integrated substrate 700 includes glass.In some embodiments, the single integrated substrate 700 is made ofglass. In some embodiments, the single integrated substrate 700 includesplastic (e.g., polymethyl methacrylate). In some embodiments, the singleintegrated substrate 700 is made of plastic (e.g., polymethylmethacrylate). In some embodiments, the single integrated substrate 700is made by molding (e.g., injection molding). In some embodiments, thebeam deflector device includes glass. In some embodiments, the beamdeflector device is made of glass. In some embodiments, the beamdeflector device includes plastic (e.g., polymethyl methacrylate). Insome embodiments, the beam deflector device is made of plastic (e.g.,polymethyl methacrylate). In some embodiments, the beam deflector deviceis made by molding (e.g., injection molding).

In some embodiments, the single integrated substrate 700 is opticallytransparent. In some embodiments, the single integrated substrate 700 isoptically transparent to a visible light (e.g., the single integratedsubstrate 700 is optically transparent for a visible light spectrum,such as from 400 nm to 650 nm). In some embodiments, the beam deflectordevice is optically transparent. In some embodiments, the beam deflectordevice is optically transparent to a visible light (e.g., the beamdeflector device is optically transparent for a visible light spectrum,such as from 400 nm to 650 nm).

In FIG. 7A, the apex surfaces face away from the reference axis 701. Forexample, prisms located above the reference axis 701 (e.g., the prisms702, 704, 706, and 708) have apex surfaces that face up (e.g., the apexsurfaces 702A, 704A, 706A, and 708A face up), and prisms located belowthe reference axis 701 (e.g., the prisms 712, 714, 716, and 718) haveapex surfaces that face down (e.g., the apex surfaces 712A, 714A, 716A,and 718A face down).

In some embodiments, connecting regions are located between prisms ofthe second array of light-steering components. In FIG. 7A, a connectingregion 703 is located between the prism 702 and the prism 704, whichfacilitates a ray exiting from the prism 702 to propagate withouthitting the prism 704. Similarly, a connecting region 705 is locatedbetween the prism 704 and the prism 706, which facilitates a ray exitingfrom the prism 704 to propagate without hitting the prism 706, aconnecting region 715 is located between the prism 714 and the prism716, which facilitates a ray exiting from the prism 716 to propagatewithout hitting the prism 714, and a connecting region 717 is locatedbetween the prism 716 and the prism 718, which facilitates a ray exitingfrom the prism 718 to propagate without hitting the prism 716. In someembodiments, connecting regions are located between all of the prisms ofthe second array of light-steering components. In some embodiments,connecting regions are located between only certain prisms of the secondarray of light-steering components. In some embodiments, no connectingregions are located between any two adjacent prisms of the second arrayof light-steering components. In such embodiments, each prism of thesecond array of light-steering components is in direct contact withadjacent prisms.

Although FIG. 7A shows a certain number of prisms (e.g., the prisms 706,708, 712, and 714) in the first array of light-steering components and acertain number of prisms (e.g., the prisms 702, 704, 716, and 718) inthe second array of light-steering components, a person having ordinaryskill in the art would understand that more or fewer prisms can be usedin the first array of light-steering components and/or the second arrayof light-steering components. In some other embodiments, the first arrayof light-steering components includes six or more prisms. In someembodiments, the second array of light-steering components includes sixor more prisms.

FIG. 7B is an example ray diagram that depicts rays of light passingthrough the beam deflector device shown in FIG. 7A.

In FIG. 7B, rays enter the beam deflector device at an angle that isperpendicular to the entrance surface of the beam deflector device.

Rays entering the prisms of the first array of light-steering elementsthrough the entrance surfaces exit from the prisms through the apexsurfaces. For example, a ray 728A enters the prism 708 through theentrance surface 708D, and exits from the apex surface 708A. The ray728A impinges on the apex surface 708A at an angle less than thecritical angle, and the ray 728A is refracted at the apex surface 708Aand is directed in the direction of a ray 728C. Similarly, a ray 726Aenters the prism 706 through the entrance surface 706D, and exits fromthe apex surface 706A. The ray 726A is refracted at the apex surface706A and is directed in the direction of ray 726C. A ray 732A enters theprism 712 through the entrance surface 712D, and exits from the apexsurface 712A. The ray 732A is refracted at the apex surface 712A and isdirected in the direction of ray 732C. A ray 734A enters the prism 714through the entrance surface 714D, and exits from the apex surface 714A.The ray 734A is refracted at the apex surface 714A and is directed inthe direction of ray 734C.

Rays entering the prisms of the second array of light-steering elementsthrough the entrance surfaces exist from the prisms through the exitsurfaces. For example, a ray 722A enters the prism 704 through theentrance surface 704D. The ray 722A impinges on the apex surface 704A atan angle greater than the critical angle, and the ray 722A is internallyreflected by the apex surface 704A (e.g., a total internal reflection)and is directed in the direction of a ray 722B. The ray 722B impinges onthe exit surface 704C. The ray 722B impinges on the exist surface 704Cat an angle that is less than the critical angle, and the ray 722B isconditionally refracted at the exit surface 704C and is directed in thedirection of a ray 722C. Similarly, a ray 720A enters the prism 702through the entrance surface 702D. The ray 720A impinges on the apexsurface 702A at an angle greater than the critical angle, and the ray720A is internally reflected by the apex surface 702A (e.g., a totalinternal reflection) and is directed in the direction of a ray 720B. Theray 720B impinges on the exit surface 702C. The ray 720B impinges on theexist surface 702C at an angle that is less than the critical angle, andthe ray 720B is conditionally refracted at the exit surface 702C and isdirected in the direction of a ray 720C. A ray 736A enters the prism 716through the entrance surface 716D. The ray 736A impinges on the apexsurface 716A at an angle greater than the critical angle, and the ray736A is internally reflected by the apex surface 716A (e.g., a totalinternal reflection) and is directed in the direction of a ray 736B. Theray 736B impinges on the exit surface 716C. The ray 736B impinges on theexist surface 716C at an angle that is less than the critical angle, andthe ray 736B is conditionally refracted at the exit surface 716C and isdirected in the direction of a ray 736C. A ray 738A enters the prism 718through the entrance surface 718D. The ray 738A impinges on the apexsurface 718A at an angle greater than the critical angle, and the ray738A is internally reflected by the apex surface 718A (e.g., a totalinternal reflection) and is directed in the direction of a ray 738B. Theray 738B impinges on the exit surface 718C. The ray 738B impinges on theexist surface 718C at an angle that is less than the critical angle, andthe ray 738B is conditionally refracted at the exit surface 718C and isdirected in the direction of a ray 738C.

In some embodiments, one or more prisms of the second array oflight-steering components have exit surfaces arranged perpendicular torays internally reflected from apex surfaces (e.g., a total internalreflection). For example, the exit surface 704C is perpendicular to theray 722B so that there is no refraction when the ray 722B exits from theprism 704 through the exit surface 704C. Similarly, in some embodiments,the exit surface 702C is perpendicular to the ray 720B so that there isno refraction when the ray 720B exits from the prism 702 through theexit surface 702C, the exit surface 716C is perpendicular to the ray736B so that there is no refraction when the ray 716B exits from theprism 736 through the exit surface 736C, and the exit surface 718C isperpendicular to the ray 736B so that there is no refraction when theray 736B exits from the prism 718 through the exit surface 718C.

In some embodiments, the prisms of the first array of light-steeringelements (e.g., the prisms 706, 708, 712, and 714) deflect respectiverays (e.g., rays 726, 728, 732, and 734) toward an optical axis of thebeam deflector device (e.g., a point 750). In some embodiments, theprisms of the second array of light-steering elements (e.g., the prisms702, 704, 716, and 718) deflect respective rays (e.g., rays 720, 722,736, and 738) toward an optical axis of the beam deflector device (e.g.,the point 750).

Ray 730 enters region 710 through entrance surface 710D. Ray 730 passesstraight through region 710 with little or no deflection.

FIG. 7C is a cross-sectional view of a beam deflector device inaccordance with some embodiments. The beam deflector device shown inFIG. 7C corresponds to a portion of the beam deflector device shown inFIG. 7A. The structure and operations of each of prisms 702, 704, 706,and 708 have been described previously with respect to FIG. 7A. Thetransmission of the rays 720, 722, 726, and 728 through respectiveprisms 702, 704, 706, and 708 has been described above with respect toFIG. 7B. For brevity, these details are not repeated herein.

FIG. 7D is a perspective view of a beam deflector device in accordancewith some embodiments. The beam deflector device shown in FIG. 7D has across-section shown in FIG. 7A. In FIG. 7D, the prisms are annularprisms arranged concentrically. Because the prisms are annular prisms,the prism 702 and the prism 718 (shown in FIG. 7A) are part of a sameannular prism (annotated in FIG. 7D as the prism 702), the prism 704 andthe prism 716 (shown in FIG. 7A) are part of a same annular prism(annotated in FIG. 7D as the prism 704), the prism 706 and the prism 714(shown in FIG. 7A) are part of a same annular prism (annotated in FIG.7D as the prism 706), the prism 708 and the prism 712 (shown in FIG. 7A)are part of a same annular prism (annotated in FIG. 7D as the prism708).

In some embodiments, each component of the first array of light-steeringcomponents is arranged radially from a center of the beam deflectordevice (e.g., the prism 708 having the apex surface 708A is locatedclose to the center of the beam deflector device, the prism 706 havingthe apex surface 706A is located outside the prism 708, the prism 704having the apex surface 704A is located outside the prism 706, and theprism 702 having the apex surface 702A is located outside the prism704).

Although the beam deflector device is, in some cases, made of atransparent material (e.g., optical glass or plastic), surfaces andlines located behind another optical surface or another optical element(e.g., hidden surfaces and lines) are not shown in FIG. 7D so as not toobscure other aspects shown in FIG. 7D. For example, the entrancesurfaces 702D, 704D, 706D, 708D, and 710D are not depicted in FIG. 7D.

FIG. 7E is a front elevational view of the beam deflector device shownin FIG. 7D. FIG. 7E also includes the cross-sectional view shown in FIG.7A to facilitate the understanding of the front elevational view. Thecross-sectional view is taken from a surface represented by line AA′ (aline that passes through a center of the beam deflector device).

FIG. 7F is a frontal elevation view of a beam deflector device inaccordance with some embodiments. FIG. 7F also includes thecross-sectional view shown in FIG. 7A to facilitate the understanding ofthe front elevational view. The cross-sectional view is taken from asurface represented by line BB′. The left side view of the beamdeflector device is identical to the cross-sectional view. The rightside view of the beam deflector device is a mirror image of the leftside view.

FIG. 7G is a schematic diagram of a beam deflector device in accordancewith some embodiments. The beam deflector device shown in FIG. 7G has arectangular array of prisms (e.g., a square array of prisms, such as a9×9 array of prisms). The rectangular array of prisms is configured tosteer light entering through the rectangular array of prisms toward acommon focal point. A side view of the beam deflector device shown onthe left side of FIG. 7G also illustrates that the prisms of the beamdeflector device steer light toward a common focal point (although thelight steering components are shown as flat elements in the side view,the light steering components have a wedge shape, as shown in FIG. 7A).The first array of light-steering components (e.g., the shadedlight-steering components) have an apex angle that is less than thecritical angle and the second array of light-steering components (e.g.,the light-steering components located outside the first array oflight-steering components) have an apex angle that is greater than thecritical angle, as described above with respect to FIGS. 7A and 7B.

FIG. 7H is a schematic diagram of a display device with a beam deflectordevice in accordance with some embodiments. In some embodiments, lightis generated by a two-dimensional array of pixels 770 (e.g., liquidcrystal display elements). In some embodiments, the two-dimensionalarray of pixels 770 is a liquid-crystal display (LCD). In someembodiments, the two-dimensional array of pixels 770 includes organiclight-emitting diodes (OLEDs). In this figure, the light from thetwo-dimensional array of pixels 770 is illustrated by rays 780, 781,782, 783, 784, 785, 786, 787, and 788. In some embodiments, the raysfrom the two-dimensional array of pixels 770 pass through atwo-dimensional array of lenses 771. In some embodiments, there may bemore than one two-dimension array of lenses in the path of the rays. Insome embodiments, the two-dimensional array of lenses 771 is omittedfrom the display device.

The light passes through a beam deflector device 772, which correspondsto any of the beam deflector devices described herein (e.g., the beamdeflector device shown in FIGS. 7A-7F or their variants). Ray 784 is atthe center of the two-dimensional array and passes straight throughwithout deflection into the pupil 330 of the eye 325. Rays 782, 783,785, and 786 (e.g., rays that require a small deflection) are deflectedby the prisms in the first array of light-steering components of thebeam deflector device 772. Rays 780, 781, 787, and 788 (e.g., rays thatrequires a large deflection) are deflected by the prisms in the secondarray of light-steering components of the beam deflector device 772.

By directing light from a large display screen to toward the eye 325,the display device can deliver light through the pupil 330 of the eye325 regardless of whether the user is looking up, down, left, right, orstraight. Accordingly, the display device with the beam deflector devicecan provide a more immersive virtual reality and/or augmented realityenvironment, which improves the viewing experience.

In some embodiments, the two-dimensional array of pixels 770 and thebeam deflector device 772 are all contained within the head-mounteddisplay device 100 (FIG. 1). In some embodiments, the head-mounteddisplay device 100 also includes the two-dimensional array of lenses771. In some embodiments, the head-mounted display device 100 alsoincludes a dynamic beam steering device (e.g., an electro-optic beamsteering device, such as a dynamic liquid crystal beam steerer).

In light of these principles, we turn to certain embodiments.

In accordance with some embodiments, a beam deflector device includes asingle integrated substrate (e.g., the single integrated substrate 700in FIG. 7A) that has a planar entrance surface (e.g., the entrancesurface 790) and a non-planar exit surface (e.g., the surface that isopposite to the entrance surface). The single integrated substrateincludes, on the non-planar exit surface, a first array oflight-steering components (e.g., the prisms 706, 708, 712, and 714). Arespective component of the first array of light-steering components islocated at a respective distance less than a predefined distance (e.g.,the predefined distance 777) from a reference point (e.g., a referenceaxis 701). The respective component of the first array of light-steeringcomponents includes an optical prism having an apex angle that is lessthan a critical angle (e.g., the prisms 706, 708, 712, and 714). Thefirst array of light-steering components includes a first prism (e.g.,the prism 708) having a first apex angle and a second prism having asecond apex angle that is distinct from the first apex angle (e.g., theprism 706). The single integrated substrate also includes, on thenon-planar exit surface, a second array of light-steering components(e.g., the prisms 702, 704, 716, and 718). A respective component of thesecond array of light-steering components is located at a respectivedistance greater than the predefined distance from the reference point.The respective component of the second array of light-steeringcomponents includes an optical prism having an apex angle that isgreater than the critical angle.

In some embodiments, the second array of light-steering componentsincludes a third prism (e.g., the prism 702) and a fourth prism (e.g.,the prism 704). The third prism has a third apex angle that is distinctfrom the first apex angle and the second apex angle, and the fourthprism has a fourth apex angle that is distinct from the first apexangle, the second apex angle, and the third apex angle.

In some embodiments, the first prism, the second prism, the third prism,and the fourth prism are configured to steer at least a portion of lightpassing through the planar entrance surface (e.g., rays that enterthrough the planar entrance surface at an angle that is perpendicular tothe planar entrance surface) toward a common focal point of the beamdeflector device (e.g., the point 750 in FIG. 7B).

In some embodiments, the first array of light-steering components andthe second array of light-steering components are configured to steer aportion of light passing through the planar entrance surface toward acommon focal point of the beam deflector device. For example, in somecases, the apex angle of each component of the first array oflight-steering components and the second array of light-steeringcomponents (e.g., each prism of the first array of light-steeringcomponents and the second array of light-steering components) isselected to steer a portion of light entering the respective componenttoward a common focal point of the beam deflector device.

In some embodiments, the beam deflector device is configured to focuscollimated light entering the beam deflector device through the planarentrance surface toward a common focal point of the beam deflectordevice (e.g., FIG. 7B).

In some embodiments, each component of the first array of light-steeringcomponents has an apex angle that is different from an apex angle of anyother component of the first array of light-steering components (e.g.,the apex angle 706X of the prism 706 is distinct from the apex angle708X of the prism 708), and each component of the second array oflight-steering components has an apex angle that is different from anapex angle of any other component of the second array of light-steeringcomponents (e.g., the apex angle 702X of the prism 702 is distinct fromthe apex angle 704X of the prism 704).

In some embodiments, the apex angle of the respective component of thefirst array of light-steering components is defined by the planarentrance surface and an apex surface that is distinct from the planarentrance surface (e.g., the apex angle 708X of the prism 708 is definedby the planar entrance surface 708D and the apex surface 708A of theprism 708). The respective component of the first array oflight-steering components is configured to allow light entering therespective component through the planar entrance surface to exit fromthe respective component through the apex surface (e.g., in FIG. 7B, thelight entering the prism 708 exits from the prism 708 through the apexsurface 708A). The apex angle of the respective component of the secondarray of light-steering components is defined by the planar entrancesurface and an apex surface that is distinct from the planar entrancesurface (e.g., the apex angle 704X of the prism 704 is defined by theplanar entrance surface 704D and the apex surface 704A of the prism704). The respective component of the second array of light-steeringcomponents is configured to allow light entering the respectivecomponent through the planar entrance surface to internally reflect fromthe apex surface of the respective component (e.g., the apex angle 704Xis greater than the critical angle so that the light entering the prism704 at an angle that is perpendicular to the entrance surface 704D isreflected from the apex surface 704A by a total internal reflection).

In some embodiments, the apex surface is a planar surface (e.g., FIG.7F). In some embodiments, the apex surface is a planar circumferentialsurface (e.g., FIG. 7D).

In some embodiments, the respective component of the second array oflight-steering components has an exit surface that is distinct from theplanar entrance surface and the apex surface (e.g., the exit surface704C of the prism 704). The respective component of the second array oflight-steering components is configured to allow light entering therespective component through the planar entrance surface to exit, aftertotal internal reflection from the apex surface of the respectivecomponent, from the respective component through the exit surface (e.g.,light entering the prism 704 exits from the prism 704 through the exitsurface 704C).

In some embodiments, the apex angle of each component of the first arrayof light-steering components is selected to steer a portion of lightentering the respective component of the first array of light-steeringcomponents toward a common focal point of the beam deflector device(e.g., the deflection angle for a prism of the first array oflight-steering components is determined based on the apex angle of theprism); and an exit surface angle, defined by the exit surface and theapex surface, and the apex angle of each component of the second arrayof light-steering components are selected to steer a portion of lightentering the respective component of the second array of light-steeringcomponents toward the common focal point of the beam deflector device(e.g., the deflection angle for a prism of the second array oflight-steering components is determined based on both the apex angle andthe exit surface angle of the prism).

In some embodiments, each component of the first array of light-steeringcomponents is arranged radially from the reference point and eachcomponent of the second array of light-steering components is arrangedradially from the reference point (e.g., FIG. 7D).

In some embodiments, each component of the first array of light-steeringcomponents is an annular prism and each component of the second array oflight-steering components is an annular prism (e.g., FIG. 7D).

In some embodiments, the first array of light-steering components andthe second array of light-steering components are arranged linearly fromthe reference point (e.g., FIG. 7C).

In some embodiments, the first array of light-steering components andthe second array of light-steering components are arranged linearly intwo opposing directions from the reference point so that the referencepoint is located between a prism of the first array of light-steeringcomponents and a corresponding prism of the first array oflight-steering components and between a prism of the second array oflight-steering components and a corresponding prism of the second arrayof light-steering components (e.g., FIG. 7F).

In accordance with some embodiments, a display device includes atwo-dimensional array of pixels (e.g., the two-dimensional array ofpixels 770, FIG. 7H). Each pixel is configured to output light so thatthe two-dimensional array of pixels outputs a respective pattern oflight. The display device also includes any beam deflector devicedescribed herein. The beam deflector device is configured to transmitthe respective pattern of light from the two-dimensional array of pixels(e.g., toward an eye).

In some embodiments, the display device is a head-mounted displaydevice.

In some embodiments, the display device includes a two-dimensional arrayof lenses (e.g., the two-dimensional array of lenses 771) locatedbetween the two-dimensional array of pixels and the beam deflectordevice.

In some embodiments, the two-dimensional array of lenses is configuredto collimate light from the two-dimensional array of pixels. Thisfacilitates transmission of collimated light toward the beam deflectordevice 772.

In some embodiments, the two-dimensional array of lenses includes atwo-dimensional array of lens assemblies. The two-dimensional array oflens assemblies includes a first group of multiple lens assemblies of afirst magnification and a second group of multiple lens assemblies of asecond magnification that is distinct from the first magnification. Thefirst group of multiple lens assemblies of the first magnificationincludes a first lens assembly and a second lens assembly that isdistinct and separate from the first lens assembly. The second group ofmultiple lens assemblies of the second magnification includes a thirdlens assembly that is distinct and separate from the first lens assemblyand the second lens assembly; and a fourth lens assembly that isdistinct and separate from the first lens assembly, the second lensassembly, and the third lens assembly. Each of the first lens assembly,the second lens assembly, the third lens assembly, and the fourth lensassembly includes two or more lenses. The two-dimensional array oflenses also includes a spatial light modulator configured to selectivelyreduce transmission of light for the two-dimensional array of lensassemblies. The two-dimensional array of lenses is described above withrespect to FIGS. 6A-6J. For brevity, the description is not repeatedherein.

In accordance with some embodiments, a method includes outputting arespective pattern of light from a two-dimensional array of pixels; andtransmitting the respective pattern of light through any beam deflectordevice described herein.

Although some of various drawings illustrate a number of logical stagesin a particular order, stages which are not order dependent may bereordered and other stages may be combined or broken out. While somereordering or other groupings are specifically mentioned, others will beapparent to those of ordinary skill in the art, so the ordering andgroupings presented herein are not an exhaustive list of alternatives.Moreover, it should be recognized that the stages could be implementedin hardware, firmware, software or any combination thereof.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the scope of the claims to the precise forms disclosed. Manymodifications and variations are possible in view of the aboveteachings. The embodiments were chosen in order to best explain theprinciples underlying the claims and their practical applications, tothereby enable others skilled in the art to best use the embodimentswith various modifications as are suited to the particular usescontemplated.

For example, although the head-mounted displays are described to includea two-dimensional array of tiles, magnification devices described hereincan also be used in head-mounted displays that do not includetwo-dimensional arrays of tiles (e.g., a head-mounted display thatincludes only one or two non-tiled displays).

In another example, a beam deflector device includes a single integratedsubstrate that has a first surface and a second surface that is oppositeto the first surface. The single integrated substrate includes, on oneof the first surface and the second surface, a first array oflight-steering components, a respective component of the first array oflight-steering components located at a respective distance less than apredefined distance from a reference point and the respective componentof the first array of light-steering components comprising an opticalprism having an apex angle that is less than a critical angle. The firstarray of light-steering components includes a first prism having a firstapex angle and a second prism having a second apex angle that isdistinct from the first apex angle. The single integrated substrate alsoincludes, on one of the first surface and the second surface, a secondarray of light-steering components, a respective component of the secondarray of light-steering components located at a respective distancegreater than the predefined distance from the reference point and therespective component of the second array of light-steering componentscomprising an optical prism having an apex angle that is greater thanthe critical angle. The second array of light-steering componentsincludes a third prism having a third apex angle that is distinct fromthe first apex angle and the second apex angle and a fourth prism havinga fourth apex angle that is distinct from the first apex angle, thesecond apex angle, and the third apex angle. In some embodiments, thefirst array of light-steering components and the second array oflight-steering components are located on the same surface. In someembodiments, the first array of light-steering components and the secondarray of light-steering components are located on opposite surfaces(e.g., the first array of light-steering components is located on thefirst surface and the second array of light-steering components islocated on the second surface).

What is claimed is:
 1. A beam deflector device, comprising: a singleintegrated substrate that has a planar entrance surface and a non-planarexit surface, wherein the single integrated substrate includes, on thenon-planar exit surface: a first array of light-steering components, arespective component of the first array of light-steering componentslocated at a respective distance less than a predefined distance from areference point and the respective component of the first array oflight-steering components comprising an optical prism having an apexangle that is less than a critical angle corresponding to an angle ofincidence beyond which light is reflected by total internal reflection,wherein the first array of light-steering components includes a firstprism having a first apex angle and a second prism having a second apexangle that is distinct from the first apex angle, wherein the firstprism is in contact with the second prism; and a second array oflight-steering components, a respective component of the second array oflight-steering components located at a respective distance greater thanthe predefined distance from the reference point and the respectivecomponent of the second array of light-steering components comprising anoptical prism having an apex angle that is greater than the criticalangle, wherein the second array of light-steering components includes athird prism having a third apex angle that is distinct from the firstapex angle and the second apex angle and a fourth prism having a fourthapex angle that is distinct from the first apex angle, the second apexangle, and the third apex angle, wherein the third prism is adjacent to,and separated by a distance, from the fourth prism.
 2. The beamdeflector device of claim 1, wherein: the first prism, the second prism,the third prism, and the fourth prism are configured to steer at least aportion of light passing through the planar entrance surface toward acommon focal point of the beam deflector device.
 3. The beam deflectordevice of claim 1, wherein: the first array of light-steering componentsand the second array of light-steering components are configured tosteer a portion of light passing through the planar entrance surfacetoward a common focal point of the beam deflector device.
 4. The beamdeflector device of claim 1, wherein: the beam deflector device isconfigured to focus collimated light entering the beam deflector devicethrough the planar entrance surface toward a common focal point of thebeam deflector device.
 5. The beam deflector device of claim 1, wherein:each component of the first array of light-steering components has anapex angle that is different from an apex angle of any other componentof the first array of light-steering components; and each component ofthe second array of light-steering components has an apex angle that isdifferent from an apex angle of any other component of the second arrayof light-steering components.
 6. The beam deflector device of claim 1,wherein each component of the first array of light-steering componentsis arranged radially from the reference point and each component of thesecond array of light-steering components is arranged radially from thereference point.
 7. The beam deflector device of claim 1, wherein eachcomponent of the first array of light-steering components is an annularprism and each component of the second array of light-steeringcomponents is an annular prism.
 8. A method, comprising: outputting arespective pattern of light from a two-dimensional array of pixels; andtransmitting the respective pattern of light through the beam deflectordevice of claim
 1. 9. The beam deflector device of claim 1, wherein thefirst array of light-steering components and the second array oflight-steering components are arranged linearly from the referencepoint.
 10. The beam deflector device of claim 9, wherein: the firstarray of light-steering components and the second array oflight-steering components are arranged linearly in two opposingdirections from the reference point so that the reference point islocated between a prism of the first array of light-steering componentsand a corresponding prism of the first array of light-steeringcomponents and between a prism of the second array of light-steeringcomponents and a corresponding prism of the second array oflight-steering components.
 11. The beam deflector device of claim 1,wherein: the apex angle of the respective component of the first arrayof light-steering components is defined by the planar entrance surfaceand an apex surface that is distinct from the planar entrance surface;the respective component of the first array of light-steering componentsis configured to allow light entering the respective component throughthe planar entrance surface to exit from the respective componentthrough the apex surface; the apex angle of the respective component ofthe second array of light-steering components is defined by the planarentrance surface and an apex surface that is distinct from the planarentrance surface; and the respective component of the second array oflight-steering components is configured to allow light entering therespective component through the planar entrance surface to internallyreflect from the apex surface of the respective component.
 12. The beamdeflector device of claim 11, wherein the apex surface is a planarsurface.
 13. The beam deflector device of claim 11, wherein: therespective component of the second array of light-steering componentshas an exit surface that is distinct from the planar entrance surfaceand the apex surface; and the respective component of the second arrayof light-steering components is configured to allow light entering therespective component through the planar entrance surface to exit, afterinternal reflection from the apex surface of the respective component,from the respective component through the exit surface.
 14. The beamdeflector device of claim 13, wherein: the apex angle of each componentof the first array of light-steering components is selected to steer aportion of light entering the respective component of the first array oflight-steering components toward a common focal point of the beamdeflector device; and an exit surface angle, defined by the exit surfaceand the apex surface, and the apex angle of each component of the secondarray of light-steering components are selected to steer a portion oflight entering the respective component of the second array oflight-steering components toward the common focal point of the beamdeflector device.
 15. A display device, comprising: a two-dimensionalarray of pixels, wherein each pixel is configured to output light sothat the two-dimensional array of pixels outputs a respective pattern oflight; and the beam deflector device of claim 1 configured to transmitthe respective pattern of light from the two-dimensional array ofpixels.
 16. The display device of claim 15, wherein the display deviceis a head-mounted display device.
 17. The display device of claim 15,further comprising: a two-dimensional array of lenses located betweenthe two-dimensional array of pixels and the beam deflector device. 18.The display device of claim 17, wherein: the two-dimensional array oflenses is configured to collimate light from the two-dimensional arrayof pixels.
 19. The display device of claim 17, wherein: thetwo-dimensional array of lenses includes a two-dimensional array of lensassemblies; the two-dimensional array of lens assemblies, configured tobe positioned at a respective distance from the two-dimensional array ofpixels, includes a first group of multiple lens assemblies of a firstmagnification and a second group of multiple lens assemblies of a secondmagnification that is distinct from the first magnification; the firstgroup of multiple lens assemblies of the first magnification includes: afirst lens assembly, and a second lens assembly that is distinct andseparate from the first lens assembly; the second group of multiple lensassemblies of the second magnification includes: a third lens assemblythat is distinct and separate from the first lens assembly and thesecond lens assembly; and a fourth lens assembly that is distinct andseparate from the first lens assembly, the second lens assembly, and thethird lens assembly; and each of the first lens assembly, the secondlens assembly, the third lens assembly, and the fourth lens assemblyincludes two or more lenses; and a spatial light modulator configured toselectively reduce transmission of light for the two-dimensional arrayof lens assemblies.